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ABSTRACT 

This report suiaarizes the design strategy and 
prelioiiiary conclusions froa the first year of a study tnat attempted 
to identify educational factors that produce the differences in 
student achievement between unusually high-performing schools and 
unusually low-performing schools of similar socioeconomic 
characteristics. The sample included 21 pairs of schools from 
throughout California. Data were collected through questionnaires, 
interviews, and observation of ten teachers and the priucipal of each 
school studied. Among the most evident findings vas the importance of 
teacher perception of administrative support, ihe presence of a 
well-defined agreement and understanding between teachers and 
principals regarding the locus of responsibility and authority at 
higher-achieving schools vas noted. The study al^c noted very 
different classroom behaviors exhibited fay teachets in 
higher-achieving schools and different grouping practices between 
higher- and lower- achieving schools. Furthermore, higher-achieving 
schools reported spending more time on social studies instruction and 
less time on mathematics. (Author/JG) 
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Legislation Requiring This Report 



Assembly Bill No. 2945 
CHAIMKP 690 

An act to amend Section 128.51 of the F^ducation Code, relating to 
^( hook, making an appropriation thert'ior> and declaring:; the 
,irv:e[ic\ thereof, to take elTec't iininediatel) 

I \pj;ro\ed t\ C'j\erii(<'' August 3<>. 1976 i ued with 
Seen tar> of Sure \uguit 30. Iy76 ) 

! ar) dfloiuikj i!u* SV) (XX) approiinahoii c HUaintn! tn St t tion 2 ot AsbCn)b!\ I'll) No 

I he\n'\^ the rnone\ necrbsar\ to tomplcte this studv can be ohlaniod from the 
I )t partinrat i exjbting re'"curccs 
Wjlh the abo\e deletion. . appru\e Ai,crnbl> Bill \o 2^45 

|-D\ir\D G BROUN jR . (;o\ernor 

LFXaSLA'^i \\ E C OtNSEi;S D\CY ST 

AB 2945, Greene Schools performance stndv 

Under current law, the Superintendent of Pubhc Instruction is 
required to ij>siie a final report regarding ^.cliool performance to the 
Legislature b\ Januar\ 5, 1976 

This bill would extend the date for the submission of the final 
report to Januar> 5. 197S, would r'equire that a specified study plan 
be submitted to the legislature by July 1, 1976, and would extend the 
period over which a deMgij -ted study of school districts is to be 
toi. dueled trum 2 years to 3 years 

Tnis bill Aould also appropriare S50,000 from th * G^eral Fund to 
the Superintendent of Public Instruction for the piirposes of con- 
ducting the stud> leading to this report 

This bill uould take effect immetiiately as an urgency statute 

Appropriation yes- 

Thr people of the StJte of Cl.ilifornia do enact us follows 

SKCTION I Section 12&5i of the Education Code is amended to 
read 

128.51 The Superintendent of Pubhc Instniction shall perform an 
analysis of selected schools to ideitify educational factors which 
produce the distinction betw een Uiiusually h:gh performing districts 
and unusually low performing districts, such performance as 
measured by standard measures of school achievement. 

The schools selected for study shall be comparable in social and 
demographic characteristics and shall vary only on student 
attainment. 

The study shall last three calendar years so that vanables 
discovered the first year may be verified the second and thi'd years. 

The Superintendent of Publi;: Instruction shall report to U e 
Legislature by January 5, 1975, on the identification and descri 3tr,n 
of those socioeconomic, financial, and educational variables affecting 
school performance whijh tend to distinguish between unusually 
high-performing d'stnrts and unusually low-perfonrnng d»>tricts H\ 
Januiry 5, 1976, th S jperintendent of Public Instruction shall issue 
a report to the ' 'giJature including information regarding the 
venfiabihtv of th( -**lative impac c of the \ ariables discovered during 
the first year of tl< studv 
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The California School Effectiveness Study 



Executive Summary 

For a nunber of years, educators have been attempting to identify factors 
which inakp a difference in the educational achievement of students* Tne 
School Ef fecti'^eness Stud> was funded by the California Legislature in 1973 
(Chapter 1094, Statutes of 1973) to continue the search for school factors 
which relate to achievement. This is an interim report which summarizes a 
design strategy and preliminary conclusions based cn the first year of study 
(1974-75). This interim report will be followed by a final report summarizing 
the second-phase study. That report is scheduled for publication in January, 
1978. 

Typically, «^tudies in educational research have found that a ^arge por- 
tion of differences in student achievement is derived from background variables 
such as family income and parents* occupational status — which describe the 
student body. Students from families with income higher than average achieve, 
on the whole, at a much higher level than do students from low-income families. 
Tlierefore, studies of school achievement must be carefully designed to ensure 
that only schools with students from similar backgrounds are compared. 

The School Effectiveness Study, designed with the importance of family 
influences in mind, compared only similar schools. The selected sample in- 
cluded 21 pair<? of schools. Each pair was chosen so that one member of the 
pair was from a school whose sixth grade students had scored higher than was 
predicted on the basis of the characteristics of the students in attendance. 
Within the same pair the 'Students from the second school scored far lower 
than had been predicted. Therefore, the conclusion to be drawn is that the 
schools involved miist have been responsible for the achievement difference. 
The School Effectiveness Stu^y set out to determine how these schools dif- 
fered in their approach to schooling . 

Since the definitions of higher and lower achievement are relative to the 
initial prediction for a school aud are based on the types of students in 
attendance, it is often true that students at the ' her-achieving school of 
one pair may actually bo scoring lower than those the lower-achieving 
school of another pair. In the study Pair C was composed of two city schools 
in low-income artciS, and Pair V consisted of two suburban schools in high- 
income areas* The scores of the higher- and lowar-achieving members of each 
pair are represented in Table ES-1. As Table ES-1 shows, students at the 
lever-achieving school in Pair V actually obtained higher average scores than 
th )se at the higher-achieving school in Pair C. Therefore, it would be incor- 
niCt to compare schools without reference to the characteristics of the 
children in attendance. In this study we have compared only schools with 
similar types of students. 



In addition to tes^cores, the State Department of Education gathered 
extensive background Information from each dchdol on school size, the socio- 
economic status of enrolled children, the percentage of minority students, and 
the type of locality. I'airs of similar schools Were selected for the high, 
medium, and low levels of each of these four factors. 

For an assessment of the difference between higher- and lower-achieving 
s^uools, a number of different procedures was. used. Questionnaires were senf 
to a sample of ten teacher«? and the principal of each school; each of the ten 
teccbers and the principal were interviewed; and the ten. classrooms of those 
teachers were observed and photographed. Additionally, fiscal data were col- 
lected, but lack of consistency at the school level .forced the , cancellation of 
analysis of the fiscal data. The responr-s to the interviews, questionnaire^ , 
and oDservations were analyzed statistically by means of a comparison of the 
higher-achieving schools' responses with the lower-achieving schools' responses, 
This analysis led to devt^lopment of findings in th :ee major categories : staff 
Characteristics, measures of student and staff contact, and organizational 
processes . 

Staff Qiaracteristics 

The School Effectiveness Study revealed that principals in higher- 
achieving schools reported having much more experience as principals at their 
schools and generally being more satisfied with their position as principal 
than were those in lower-achieving schools. Principals in higher-achieving 
schools were assessed by the teachers in those schools as having more influ- 
ence over curriculum development and hiring policies. Teachers at higher-r 
achieving schools rsted their principals higher on both general performance 
standards and specific standards of ..elpfulncss arid support. 



TABLE ES-1 

S^xth Grade California Assessment Program 
Reading and Mathematics Scores, 1974-'5 



Scores in subject areas 



School 


Level 


Reading 


Mathematics 




Higher-achieving 






Pair C 


school 


50.0 


62.8 




Lower-achieving 








school 


36.7 


49.8 


Pair V 


Higher-achieving 

school 
Lower-achieving 

school 


69.2 
56.4/ 


83.7 
70.5 
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Teachers at higher-achieving schools reported being slightly older, 
having more years of teaching experience, and having obtained more college 
credit^ since beginning teaching. They also believed their faculty as a whole 
had less influence on some s'cnool-level decisions than did teachers at lower- 
achieving schools. In general, teachers at hlgher^achieving s '^oois per- 
ceived their influence on the whole to be less ^han the influence perceived 
by faculty at lower-achieving schools. Teachers at higher-achieving schools-' 
reported being more satisfie4 with various aspects of school than were 
teachers at lover-achieving schools. 

Although no relationship was discernible between achievement and the num- 
ber of counselors employed, schools differed significantly as to employment of 
counselors. Araong low socioeconomic status (SES) , schools , the lower- 
achievement schools had more counselors; among high SES schools, the higher- 
achievement schools had more counselors. 

In the area of aides and volunteers, a number of interesting relation- 
ships were discovered. Low SES schools had twice as many paid aitles per 
teacher as did middle and high SES schools. Teachers from higher-achieving 
schools reported using aides significantly more for noninsti actional tasks. 
Higher-achieving schools had slightly jpore adult volunteers than did lower- 
achieving schools, and both high and low S schools had twice as many adult 
volunteers as did schools in the mic^dle SES r^ge. - ^ ^ 

leathers from higher-achievine schools reported greater district influ- 
ence over curriculum and neacher hiring, than did teachers from lower-achievinr 
scnools. Teachers in higher-achievine schools also rated district adminis- 
tration nigher in instructional leadership and allocation of materials and 
resources and lower in effecting proup involvement in school decision n^aking. 

Although teachers from lover-achievinp schrrls reported therselve<; c^s 
having -nore influence over 'teacher hiring than did teachers from higher- 
achieving, sciio'ols, principals from lower-achieving schools did not support 
Laat contention. comparison, principals and teachers at higher-achieving 

schools tended to agree in their assessments of the locus of decision making. 
Furthermore, teachers at the h igher-achieving vschools rated their principals 
hij^her on all criteria and responded more positively than did teachers in 
lower-achieving schools regarding their relationship with their principal. 

Measures of Contact Between Students and Staff 

In terms of instructional time spent in various subjects, teachers at 
higher-achieving schools reported spending slightlv less total time in class- 
room instruction, more time on social studies, less time on mathematics, and 
about the same amount of time on readinr. and language development and on 
science. 
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Instructional anl Organizational Characteristics 

Observers perceived students in higher-achieving schools to have more 
opportunities than did students in lower-achieving schools to decide for them- 
selves about varying their tasks and activities. These students were per- 
ceived to be happier, more engaged in their work, and less disruptive, rest- 
less, or boretl. * 



Teachers at higher-achieving schools reported placing more emphasis on 
students academic performance in reading and mat. itics. Teachers at 
higher-achieving schools reported dividing their cxasses into several groups 
workmr, at different paces, while teachers at lower-achieving schools more 
frequently reported individualization of instruction. The rensops for this 
tlnd .g are^^far from clear. The data are based on what local schools de- 
scribed as individualization" together with some direct observation. The 
data have not systematically assessed the actual extent of implementation of 
individualized instruction. 

Principals were also questioned about changes over the past five years 
in the readi..g or mathematics curriculum. . Although higher-achieving schools 
reported virtually no changes, lower-ach_ Ing schools reported a moderate 
amount of change in both curricula. 

Implications and Recommendations 

Among the most evident findings of tftis study wafe the importance of 
teacher perception of administrative support. The presence of a well- 
defined agreement and understanding between teachers and principals regarding 
the locos ct responsibility and authority at higher-achieving schools was 
also noted. This study alsc noted very different classroom behaviors 
exhibited by teacher? in higher-achieving schools and different grouping 
practices between higher- and lower-achieving schools. Furthermore, higher- 
achieving schools reported spending more time on social studies Instruction 
and less time-ofi mathematics. 

In the course of the study, areas for further study have been Identi- 
fied. Including further assessment of the role of mathematics Instructional 
time in affecting achievement; sptematic study and observation of Hie 
effects of Individualized Instruction; collection of additional Information 
on the quality and extent of training for aides; and further analysis of 
patterns of summer school attendance. The State Department of Education will 
be analyzing some aspects of these issues in coming months. Meanwhile. It is 
noped that school adminlst.-ators, teachers, and educational researchers will 
find the study beneficial as they pursue their respective goals In the educa- 
tionaJ >nraunlty . ^ 
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Chapter 1 
Introduction to the Study 



The California Legislature authorized funding of the School Effectiveness 
Study to identify the socioeconomic, fin^ xial, and educational variables 
affecting studant achievement in a set of specially selected scnools (Chapter 
1094, Statutes of 1973). Designed and conducted by the California State 
Department of Education during 1974-75, this study examines those factoro 
that distinguish schools in which student achievement scores are unusually 
high from chose schools in which student achievement scores are unusually low. 

Other studies have deterraineu that a large portion of the differences in 
student achievement in the schools is derived from the background variables 
which describe the student body. For example, preliminary analysis of 1973- 
74 sixth grade student achievement scores in 4,000 California elementary 
schools showed that 65 percent of the variation among schools could be ex- 
plained by a single index of students' average socioeconomic status. That is, 
schools having higher student achievement scores were generally composed of 
students from families with highei socioeconomic status. When additional 
background indices were considered, 75 percent of the variation was explained 
statistically by a regression equation.* These results, which "uggest the 
strong influence of family status on achievement, are consistent with find- 
ings from other studies. 

In contrast to those studies which isolate socioeconomic factors, how- 
ever, fhis study is designed to isolate specific educational factors that 
influence achievement. Consequently-', the present study has two purposes: 
(1) to isolate additional information about those school factors capable of 
affecting achievement from those environment^^l and background factors that 
strongly affect that achievement; and (2) to improve sampling procedures 
that can be used to further school effectiveness and studies of student 
achievement. 

The first purpose of the School Effectiveness Study, then, iJ to shed 
light on the fact that some schools continually attain higher student achieve- 
ment levels *^^^n do other schools, even when the vitally in5>ortant background 
factors f^r both groups are virtually identical. As a result of the second 
purpose, the identification of the educational and financial factors that 
influence student ouccess and are oontrcllable by the schools became the 
focus of the study. Identification f such factors is important for deter- 
mining local educational policies and has subsequent implications for the 
reform of t' entire ^tate school finance system, however, an attempt was 
made only to descfibe the relationship between school factors and achievement; 
no attempt Was mad^ to specify the cause and effect of either higher or lower 



*For a definition of regression analysis and the definitions of certain other 
statistical terms, see Appendix B. Terms used in this report that are - 
marked with an asterisk are defined in Appendix B. 
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student achievement. Examination of the natural variation* among schools is 
simply inadequate for that purpose. Nevertheless, the study does, in fact, 
include specific findings about some educational factors which do influence 
student achievement. At the same time the stv -!cvelops some new stages in 
educational research, thus preparing the way for iur^-her study of those edu- 
cational factors influencing student achievement. 

The remainder of this report consists of four chapters. Chapter II con- 
tains a review of previous research in this area. Both earlier studies and 
the progressively complex '•esearch designs used to scndy school effective- 
ness are descrioed. Chapter III contains a description ot the research 
procedures and school selection criteria used in this study as well as design 
and metaodology, identification of variables, development of refearch instru- 
ments, and overall data analysis plan. Chapter IV contains the significant 
findings of the study and a general discussion related to Ihe findings; and 
Chapter V, the last ch^^ter, contains more sped ic conclusions as well as an 
assessment of the implications and polj y considerations to be derived from 
this study. 

Althoi^h the present study contains much information of value for assess- 
ing the factors which influence achievement, it remai^is an interim report. A 
second set of observations has been conducted at a sn^ller sample of selected 
schools to verify the findings of the f:' st-year study and provide additional 
information regarding those findings. In the second phase of this study, 
different methodology, including primary use of the anthropological method of 
nonparticipant observation, is used in an attempt to explain further the 
ramifications of the first-year findings. 

The final report of the second phase of the School Effectiveness Study 
is expected to be available in January, 1978. » 
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Chapter H 

Review of the Literature on School Effectiveness 



This review of the literature* cn srhool effectiveness contains r brie»^ 
analysis of some ci the more important! tronds and studies in the field. At 
the sarae time a synthesis of a sampling of the critical literature and an 
analysis of the underlying modelj of these studies are presented. An attempt 
is^made to discover the strengths and weaknesses of the models and to suggest, 
possible improvements for future studies. The review is designed to provide 
a context that will clarify the contributions which this srudy makes to an 
understanding of school effectiveness. 

Because the School Effectiveness Study has two Important purposes — the 
seaic' for ^LOgram characteristics related to student achievenent and the 
deveiop-nent of a sophioticaued sample selection process — the review of the 
literature is alvided into n^o parts. Part A contjiins a review of school 
effectiveness research designs; Part a brief survey of findings from pre- 
vious representative [Studies of educatitjnal variables related to achievenent • 
The first part of the review is a chronological survey of progress in research 
design, and the second part is a categorical breakdovm of variables or^ zed 
parallel to the conclusions and discussions of Chapter IV, 

A. Chronological Survey of Progress in Research Designs 
for School Effectiveness Studies 

For a number of years, educators have been attempting to discover those 
factors which make a difference in the educational achievement of students. 
Recently, that effort has been accelerated for at least two reasons: (1) the 
significant concern, evidenced especially in the 1960s and exeripiified by 
the mandate which produced the Coleman Report,* tl at students in every seg- 
ment of societal; have an equal opportunity to receive educational benefits; 
and (2) the pressure placed on state and local government by tight budgets. 

"I . , The Earlier Years 

Amor^^ the earliest studies in school effectiveness were the cost-quality 
analyses conducted by Mort. Using expenditures as a measure of school excel- 
lence, !iort and a number of other early researchers found that in school 
districts with greater expenditures, students tende*.' to achieve at a mucl 
higher level. 

Although the work of Mort and his immediate followers was considered a 
breakthrough in educational research, subsequent researclers realized that 
the original ^cost-quality studies were deficient in not accounting for exper- 
iences outside the school which could differentially affect acliievement . 
Among the first to include these socfoeconoipic considerations was Wilson 
(1^59), who analyzed the links between social class and aspirations (as a 
proxy for the usual dependent variable* oi achievement). The California 
Senate Fact Finding Conanittee on Revenue and Taxation (1965) conducted a 
subqequent study of the relationship bcDreen socioeconomic status, school 
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factors, and school achievement. Froiii an analysis of 25 independent vari- 
ables* representing school and socioeconomic characteristics and the depen- 
dent variable of scores on a reading achievement test, the researchers 
concluded that a positive relationship existed between teacher experience 
and :;tud€nt achieveman\ independent of the link between the students' home 
environment and achieveiient. This study was one of the early attempts to 
suggest specific educational factors that might influence achievetnent. 

2. The Coleman Report , 

However, with the pullicatlon of Equality of Educational Opportunity 
(Colemun, 1966), researcheic - ^heir attention away from the nonenviroi 
menial factors influencing t. After two years of research, which 

included a sampling of 900,.^^ . 'udenis on achievement and aptitude tests, 
questionnaires on family background, and collection of data from adminis*" 
trators and teachers at each of the schools included in this study, che 
findings included the statement that: 



Taking all these results together, one implication stands 
out above all: that schools bring little influence to bear 
upon a child's achieve*jent that is independent of his 
background and general social context; and that this very 
lack of independent effect means that the in^iqualities 
imposed upon children by their home, nei;^ ' borhood, and 
peer e^^vironracnt are carried along to become the inequal- 
ities with which they confront adult life at the end of 
school, (p. 323) 



The Equality of Educational Opportunity report was originally designed 
to fulfill a congressional mandate of the Civil Rights Act of 1964 to report 
to Congi'ess on the availabil'. y of equal educational opportunities for persons 
of all races, creeds, colors, and national origins. Its publication set off 
a furor in educational circles. The furor arose about what public policy 
conclusions should properly be drawn from a report that many believed indicated 
that "schools do not make a difference" and, therefore, that spending for 
education could be maintained at current levels or could even be reduced 
without affecting academic achievement or equality of educational opportunity. 

Others (Guchrie, 1973; Hanushek and Kain, 1972; Bowles and Levin, 1968) 
reached quite different conclusions . • Although these educators praised the 
Coleman report for Its magnitude and 5Coj>e, tney asserted that its sampling, 
methodology, and statistics prevented the use of its data for policy purpose*'. 
Basically, they criticized: (1) inadequacy of the sample and effect of non- 
response rates; (2) limitations of questions asked on the survey instruments; 
and (3) inadequacy of controls in the analysis stage of relating school inputs 
to student performance. Educators hoped that such strong criticism would 
advance the art of data collection and appropriate analysis of the data. 

Because the Coleman report had relied so heavily on the statistical 
technique of regression analysis, it became the predominant r ^de of analysis. 
In this form of analysis, achi^ement scores are set ud as the dependent 
variable, and researchers use regression methods to ef mate the proportion 
of weight which each independent variable contributes the total achieva- 
ment score. Among the researchers who published studiej in this style were 
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Burkhead (1067), Cohn (1968), Hanushek (1968), Katzman (1968), Ra>mond (1968), 
Bowles (1969), Bowles and Levin (1968), Ribich (1968), and Klesling (1969). 
In each study the resaarcher tried to control the home environment of students 
statistically to show which school variables were most important in deter- 
mining achievement. These researchers identified a number of variables ranging 
from less consequential items such as the median age of school buildings to 
more essential ones such as teacher experience, student expectations, and the 
student-staff ratio. Although no absolute consensus was reached regarding the 
definitive mix and proportion of various school services, two things that did 
become apparent in these studies were (1) that a fair degree of consistency 
was evident in the studies' findings; and (2) that school services could play 
an important role in affecting achievement. 

In 1971 Guthrie reviewed the majority of such studies conducted during 
1965 — 68. In his summary of these works, he rank-ordered four major areas of 
consensus among researchers. He identified four areas of educational factors 
influencing achievement: 

1. Variables relating to the number .of professional staff members and 
their chrracteristics , such as verbal ability, experience, and 
amount and type of academic preparation 

2. Measures of contact between students and professional staff, includ- 
ing student-staff ratios, classroom Glze, school or district size, 
and length of school year 

3. Service components, such as age of school buildings and adequacy 
and extent of physical facilities for instruction 

4. Spending levels of various factors, including expenditures per pupil 
and teachers' salary level 

Although Guthrie's conclusions were optimistic, researchers remained 
cognizant of the continuing inadequacies as well as the advances in educa- 
tional research. These researchers were we"*! aware that, aitnough some school 
effects had become apparent, much information continued to be lost because of 
the lack of sophistication of the estimation models (i.e., the model of linear 
regres«?ion) • 

For example, one type of short'joming was that status rather than process 
variables were measured. The difference between the two is quite important in 
a schoal setting where the interaction between student and teacher is integral 
to the educational process. Status variables generally represent objective, 
measurable characteristics such as age, years of education, length of school 
day, highest academic degree received, or student-staff ratio. Process 
variables represent much more subjective, less easily quantifiable areas such 
as the quality of instruction, the attituces which students bring to school, 
the relationships and balance of authority between principals and teachers, 
and the balance of the control assimed by parents and other community persons 
in school decisions. The development of the distinction between status and 
process variables marked a step forward in education research by refining 
the researcher's ability to study specific school factors influencing student 
achievement. 
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3. Hlgh-Lov Studies 



Another new avenue of inquiry opened up about 1972. Researchers devel- 
oped methods for coraposing predictions of achievement from several key vari- 
ables. In turn these researchers were able to assess school effects in 
reference to the level o^ achievement predicted for that school-. As a con- 
sequence a number of states began designing "high- low" studies, which 
isolated pairs of schools in which children came from families of equivalent 
socioeconomic status^ yet whose scores on standardized achievement tests were 
widely disparate. This methodology was designed to neutralize the impact of 
cultural and social factors upon school achievenent so that researchers could 
concentrate on school factors which influenced the school's effectiveness* 
In addition to the coaq>arison with normalcy, this approach ^Iso placed educa- 
tional research one snep closer to a controlled laboratory setting rather than 
the naturalistic, uncontrolled setting ±i\ which most educational research had 
hitherto been conducted. 

One of the first of such studies attempting to measure relative perfor- 
mance was conducted by White (1972), who used 1970-71 and 1971-72 data for 
the Atlanta school system. The researchers began by setting up a scatterplot* 
of achievement against the percentage of free and reduced-price lunch parti- 
cipation (as a proxy for socioeconomic status) for all schools and grades 
studied. Tften the rasearchers used statistical techniques to establish the 
curve of best fit. Subsequently, parallel bands were drawn above and below 
the regression line at 15 percent and 25 percent intervals. The schools were 
given "signals" (red or blue full- or half-shaded symbols) to identify in 
which of the five bands^ that school was situated.'' 

Relative performance levels similar to those defined in Atlanta were 
first used for analysis of school effectiveness in New York State (1974). 
After matching inner-city students by characteristics of median family in- 
come, percentage of families on welfare, and several other indicators of 
socioeconomic status, two inner-city schools were paired for study. In one 



As measured by variables such as median family income, pupil ethnicity, 
percent bilingual, pupil mobility, and family breadwinner's occupation. 

Achievement bands: (1) more than 25 percent below prediction; (2) between 15 
and 25 percent below prediction; (3) between 15 percent below and 15 percent 
above prediction; (A) between 15 and 25 percent above prediction; and (5) 
more than 25 percent above prediction. 

^The Urban Institute then made the relative performance information wiat''y 
available within the Atlanta school system and observed the influence ot 
this information on decisl making in areas related to student performance. 
For further information or the results of this study, see Bayla F. White and 
others. The Atlanta Project ; How One Large System Responded to Performance 
Information (Washington, D.C.: The Urban Institute, Mr.rch, 1974) . 
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of these schools, students had scores consistently high^; in the second 
school, students had scores consistently low. 5 Intensive interviews and obser- 
vations focused on the major areas of administrative and teacher character- 
istics, reading curriculum and instruction, and school and classroom climate. 
The teaip of researchers concluded that the differences in the two schools 
were ''primarily attributable to administrative policies, behaviors^ proce- 
dures, and practices" which were controllable at the school level. Both the 
administering team's instructional and management skills as well as their 
attitude and optimisn toward the children's learning ability combined to make 
the school one in which children scored well above their predicted achievement 
levels . 

in contrast a number of areas intuitively viewed as determinants of 
success did not vary signi 'icantly. These included effectiveness and "appro- 
priatent»ss of the teaching, training and experience of teachers, appropriate- 
ness anc availability of materials, and approaches to reading instruction." 
Although some findings of thij study contradicted commonsense notions, their 
value lay in the revelation that process variables could be assessed and that 
additional research in this vein was indeed worthwhile. 

The Massachusetts Advisory Council on Education (MACE) broadened the 
research of the New York staff when the council contracted with the Educa- 
tional Research Corporation (ERG) to construct a similar, but slightly larger, 
study which paired "successful" and "contrast" schools to assess the critical 
features for effective learning (Ellis, 1975). In this instance also, the 
study focused on 20 inner-city schools in which the average achie\^ment of 
half the schools was at or above grade level in comparison with national 
norms. The average reading scores in the second half were 1.3 grade equiva- 
lents below national norms. These differences occurred even though the 
schools were paired after being matched for measurements of poverty, racial 
composition, and proportion of bilingual studen'-s. In five-day /Islts to 
each school, the teams engaged in research which included systematic obser- 
vation of reading, structured interviews with various school staff members, 
and collection of background data on the entire staff together with demo- 
graphic and home background data on students. The reseirchers divided the 
data gathered from these instruments into the following 11 categories: 
leadership; coordination of reading activities; extra reading personnel; 
school atmosphere; individualization; evaluation of oupil progress; high 
expectations; strong emphasis on reading; use of phonics;^ staff training and 
experience; and quality of teaching. Once again, a controlled study focused 
on process variables within the school setting 



Mcr3 than half of the students were reading at or above the acceptable com- 
petency leve] for their grades on the Pupil Evaluation Program Tests , and 25 
percent were reading at or above grade level o:: nationil norms on the Metro^- 
politan AchieveTrent Tests * 

^Only 16 percent of these students were reading at or above the state-defined 
competency It^vel for their years on the Pupil Evalu&tion Program Tests y, and 
a mere 10 percent were ^reading at or above grade level. 
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As a result of the complexity of their design and analysis, ERC research- 
ers arrived at conclusions which were stratified* into several categories. 
All categories rated low on coordination and individualization, and as a result 
these variables were el^-.lnated. Overall, the successful schools placed uni- 
tormly strong stress on reading and provided high quality teaching. 

Tfie general findings of the Massachusetts researchers supported the hy- 
pothesis that emphasis on reading, quality of teaching, r.tm phere, staff 
training and experience, leadership, expectation, use of additional reading 
personnel, and evaluation are "good candidates to be the determining factors 
of success. The study also concluded, however, "that ... there is discern- 
ible no single pattern of school factors that determines excellence." There- 
fore, Instead of imitating a model of excellence, the study recommended "that 
, schools focus on the process by which they can achieve excellence, each school 
thereby establishing its own brand or ?att m of factors." The implication 
that schools could overcome background factors, as was showr in the New York 
study, was confirmed in the Massachusetts study. 

A subsequent study by economists at the Federal Recserve Bank ot Philadel- 
phia reverted to the earlier st-le of using an economic model with neither 
outcome predictions nor comparison schools included in the design. Their 
major finding (Summers ard Wolfe, 1975) was that: 

School inputs (such as class size and teacher experience) 
do help students grow in educational achievement and can 
compensate for the disadvantages of poverty, race, and 
low ability. Moreover, many inputs have a larger impact 
on some students' performance than others. Small classes, 
for example, help low achievers, but are of no special 
benefit to average achievers. Further, some characteris- 
tics of staff Inputs— extra educational credits of teachers, 
for example— do not appear to boost learning. 

Although the Philadelphia study provided several interesting findings, it 
primarily reemphasized an economic mode oi analysis in which status variables 
and regression analysis were used. 

The Michigan State Department of Education (1974) contracted for a high- 
low matched study in which 25 high-achievin.^ and 23 low achieving compensatory 
education sites in Michigan were examined. The research was an effort to 
discover educational practices which can effect changes in student behavior 
and the costs associated with those practices. Variable groupings included 
in the study were staff variables; organization and management of the r verall 
progiam; organization and management of classroom reading activities; meth-^d 
of instruction; staff development; student characteristics; school and school 
district characteristics; utillzat .n of staff time; and participants. The 
general conclusion of the resear. was that definite program characteris- 

tics which are controllable by sch . district staff can make a difference in 
determining school achievement (Mi.tiigan Department of Education, 1975). 
Among these controllable characteristics are: 

• The classroom monitoring role of the principal and the manner in 

which the princlipal allocates his time and delegates decision making 
in certain areas to the clasbioon :eachers 
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• The role of teachers, the degree of decision iraking delegrted to 
them, and the amount of time the teacners allocate to instructional 
management activities, including diagnosis 

• The amount of time allocated by the director and teachers of compen- 
satory education to planning and preservice training (pp. 2-3) 

The Michigan study's primary contributions to school effectiveness research 
were the determination of a set of factors systematically related to student 
reading achievement and the finding that, within limits, more financial 
resources, when properly used, yield increased student achievement. 

This brief chronological survey of research designs used in school 
effectiveness studies suggests the importance of continued research and 
development of methods which can accurately isolate specifically educational 
factors from environmental ones that affect student achievement. This study, 
then, is a continuation of thin effort in educational research. 



B. Categorical Breakdown of 
Specific Variables of Interest 

This section of our review of earlier studies is focused on the major 
fields of interest, which are divided into three categories. These three 
categories are shaped, to some extent, by the conclusions reached in Chapter 
IV. That is, certain variables have been placed in three categories to 
facilitate the understanding of the findings: 6taff characteristics, measures 
of student-staff interactions, and instructional and organizational processes. 

1 . Staft Characteristics 

The primary categories of school personnel are the principals and teach"" 
ers; aides and volunteers hold ancillary positions. In the past, principals 
have frequently been studied as a group. In the 1920s a number of researchers 
began to focus first on ratings to determine success (Cranor, 1921; Spenser, 
1922; Rich, 1922; Touten, 1923) and later on lists identifying principals' 
duties (Briggs, 19A3; D. L. Lewis, 1938; Kelly, 19A7; Elsbree, 1951; Romine, 
1930). Leadership traits which could easily be linked to necessary adminls-^ 
trative behavior were also assessed in subsequent studies (Reavis, 19^0; 
National Education Association, 1948; Shaiinc 1948; Smith and Sprowles, 1954). 
In the 1950s increasingly 8ophi8tic^»tcd studies emphasized the importance of 
the quality of performance (Ramseyer, 1955; New Jersey Education Association, 
1969). Even in 1971, however, Kieslinft could conclude that, despite earlier 
research » educators remained ''abysmally ignorant of the traits of a good 
school manager." 

In 1966 Levlne's research emphasized the necessity for "vigorous and 
highly skilled" administrators to promote and to maintain adequate education 
levels in low-income scho^ds. Furthermore, he stressed the necessity for 
communication between principals and faculty on the importance of "structured 
and constant learning environments." Similar findings that tended to link 
certain characteristics of administrators to student achievement were published 
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by Weber in 1971. After studying four exemplary schools, he determined that 
"strong leadership" involving initiation and direction for the reading program 
were strong factors in student success* 

Yet en in 1973 only limited assessments had been made of administra- 
tive qu l-^ies that contribute to a school's success. After conducting a com- 
prehensive review of research Into school resources, for example, Helm (1972) 
found that only four studies had related student achievement to administrative 
characteristics. All four studies had dealt with student-administrator ratios, 
and none had found any correlation between the latios and student achievement. 
Thus even these four studies were limit(*d in the implications one could draw 
as to the relationship between aJministration and student achievement. 

Teachers well as principals haye been a frequently studied group. 
Although Coleman concluded in 1966 that teacher characteristics accoimt^ ' for 
more variation in cognitive areas than did any other school variables, other 
studies associated the effects of teachers with those of prlnripals. Levlnc's 
1966 study^'fe tressed comnii/nicatlon between principals and teachers, ar.d Lutz 
and Evan^ 1968 work emphasized the importance of bridging "the chasm that 
separates the perceptions ot teachers and principals." 

The pe ception of the prlncl -teacher relationship and the satisfaction 
ic can yiehl may also be import? for achievement outcomes. Charters (1963) 
r^ted chat the assumption of a rela'-lonshJp between teacher satisfaction and 
"chc! teaching-leariiing process* was "in w^nt of conceptual specifications." 
Lortie (19 73) recommended a closet look at the repetitive demands that work 
makes upon teachers and their assessment of these demands as an indication of 
their attitude? and subsequent actions. Zander's (197A) interest!? were 
related more to group processes* He emphasized that the performance of a 
group such as teachers couJd be improved by creating conditions that would 
nourish their desire for success -nd reward them for their accomplishments. 

These researchers laid the groundwork for the study of personnel in the 
Schoul Effectiveness Study. Although individual studies have shown the impor- 
tance of isolated characterlLtics of teachers and principals, the School 
£f fectiveness Study tesced for verification of these characteristics and their 
interdependencies . 

2. Measures of Contact between Students and F^aff 

Various researchers have ass^ited thnt the relationship between Instruc-- 
tional time and learning is a strong, positive one. Carroll (1963) devised a 
model for school learning and stressed the importance of students being 
allowed sufficient time to master va-ious educational skills . Harris and 
Scrwer (1966) analyzed reading approaches for disadvantaged New York City 
schoolchildren and concluded that the amount of time per day spent in reading 
activities was a significant factor in reading achievement. However, Husen 
(1972) reviewed a number of international studies and concluded that no 
strictly line ar relationship had been found wb irh could correlate exposure to 
teaching with student achievement. But in 1974 Wiley and Harnischfeger pointed 
uut that the research methods which Uusen used in drawing his conclusions were 
not designed with this type of study in mind. They also reported in their own 
research that the number of hours of instruction per year was related to gains 
in reading » verbal skills » and mathematics. Their conclusirn was that amount 
of instructional time is "a highly relevant factor" for achievement. 
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In addition, Stallings' evaluation of the Follow-Through program (1975) 
revealed a direct positive relationship between the amount of time a child 
spends in reading activities with an adult and the child's achievement scores. 
Furthermore, Stallings found that the amount of time spent on social studies 
was strongly related to reading achievement. Like Stallings, Bloom (1974) 
provided strong reinforcement for the notion of a positive relationship 
between time and learning. After reviewing several studies conducted at the 
University of Chicago, he concluded that the amount of time spent on learning 
is "highly predictive" of student achievement. On the basis of these findings, 
he stressed the attractiveness of tine as a variable, aj.d he encouraged 
additional study. . 

In spite of all the positive research on time, additional research nt^eds 
to be conducted. Husen (1972) ha" emphasized some of the thorny problems in 
assessing the importance of time — among them are the necessity of accounting 
for parental education, rural-urban residence, and teacher competency as 
possible interacting variables. The School Effectiveness Study is designed 
to disregard out-of-school variables; it analyzes the within-category inter- 
actions. However, the interplay of time utilization, teacher competency, and 
actual classroom activity need further Research. 

3. Instructional and Organizational Characteristics 

Research has often indicated that instructional processes and organiza- 
tional characteristics that accompeny them can affect student achievement. 
Two of the major issues in this category include classroom grouping practices 
and instructional styles. 

Assessing research on instructional styles and organizational processes 
nay have been the most difficult of the areas reviewed. Although thousands 
of studies have been conducted, relatively little is known about desirable 
teacher characteristics or the influence of teachers on student achievement. 
Although many rating scales have been devised, they seldom correlate* strongly 
with student achievement (Harris, 1969). Rosenshine and Furst (1971) re- 
viewed a number of experimental and correlational studies of Instructional 
style and listed five variables which a^e strongly supported by that research 
as related to achievement outcoines. They Include clarity of presentation, 
variability of activities, teacher enthusiasm, degree of task- or achievement- 
orientation or businesslike attitude, and student opportunity. Additional 
confusion in this area is created in that, even among themselves, educators 
cannot agree on whether personality characteristics or instructional style is 
more important for student achievement. Although many educators categorize 
instructional style as more important, others contend that personality 
characteristics such as ability to motivate students are more important than 
the manner of imparting information. 

Research performed in the sane year ty Gordon (1975) found similar styles 
to be important when he conducted a nationwide study of ESEA, Title I projects. 
He found that a tightly structured program — including frequent and Immediate 
feedback combined with a tutorial relationship, individual pacing, and some- 
what individualized programming — is positively related to achievement by 
low socioeconomic status students. 
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A large number of studies have been conducted on classroom grouping. The 
best review of the studies was conducted by Thelen (1967), who reported that 
homogeneous grouping (ror example, by Intelligence or performance) does not 
differ from heterogeneous grouping in Its effects on achievement. He Indicated 
that the more Important variable may be teaching method. For example, a 
teacher Is unlikely to Increase achievement significantly by using the same 
methods, assignments, and challenges regardless of the type of group. More 
achleverient Is to be expected In classes or groups where the teacher fully 
understands and responds to the specific needs of that class or group • 

At least three other studies (Berliner, 1967; Soar, 1973; and Scaiiings, 
1975) have also examined grouping strategies as part of larger studies on 
Instruction and organizational styles. In their classroom studies (of begin- 
ning teachers and Follow-Through edtication??l models, respectively), they 
determined that the presence or absence of a supervising adult was more impor- 
tant than either the size or number of groups within a classroom. 

The School Effectiveness Study examines both classroom grouping and 
pacing and Instructional styles to expand on the ideas propounded by earlier 
researchers- The Intent is to clarify the findings of earlier studies. 

C. Summary o'' tne Chapter 

The review of previous studies discussed in this chapter lays the basic 
groundwork for development of the present School Effectiveness Study method- 
ology. The cost-effectiveness studies of earlier years evolved into a more 
sophisticated form of matching schools to remove socioeconomic effects from 
school variables under study and tc investigate the variables 'which distin- 
guish high-achieving from low-achieving schools. Simultaneously, the collec- 
tion of data has progressed from amassing status variable information such as 
the number of years of teachers' experience ^tA type of college or university 
attended to the initial collection of process or interaction variables, in- 
cluding assessment of classroom organlratlon and teaching quality. Recently, 
more investigation has been conducted in which on-site observation is made. 
As a consequence, more information regarding process variables has begun to 
emerge in these later studies. 

A number of othsr patterns have become evident from past tudles. Impor- 
tant teacher variables range from verbal ability, salary, and type of graduate 
institution 10 staff development, attitudes, and use of time. Staff charac- 
teristics " ve also been emphasized in the great number of studies which have 
charted administrator attributes and activities as influencing achievement. 
Class size, ability grouping, and expenditures have ;!lso been frequently men- 
tioned as important independent variables. The current need, howeyer, is for 
a coordinated look at schools and a study of the relationship of the variables 
identified in that analysis. 

The School Effectiveness Study advances research within the field by 
means of additional development of the procedures for school selection to 
Include those at all socioeconomic levels. The study focuses on and refines 
further the specific categories of personnel characteristics and behavior, 
measures of contact betveen students and staff, and Instructional and organi- 
zational processes which many of these earlier studies hypothesized as 
effective. 



Chapter III 
Design and Methodology 



Design and methodology are the foundations of any research study. The 
intent of this chapter is to describe the research methods used in the School 
Effectiveness Study in sufficient detail so that the methods can be assessed 
and used by other researchers. What follows, then, is a scries of subheadings 
outlining both the basic design and methodology used. In general the discus- 
sion under each of these subheadings is relatively more technical tlian is the 
remainder of the report. 

A. Achievement Scores and School Selection 

Twenty-one pairs of California elementary schools were selected for 
study. Of approximately 5,500 elementary schools in California, about 2,000 
were eliminated from further consideration because sufficient information or 
those schools was not c.ntained in the State Department of Education's ele- 
mentary school 'zowputer information system. The following data were avail- 
able for the remaining 3,500 schools: 

1- Achievement scores on the Comprehensive Tests of Basic 
Skills : 

Scores on the Comprehensive Tests of Basic Skills were the 
scores achieved on testa administered to ,ixth graders in 
both 1972-73 and 1973-74 as part of the California Assess- 
ment Program. The scores were subsequently reported to 
the State Department of Education. Only the scores from 
schools with at least 16 sixth-grade students were used. 
As a result, scores from very small schools were not 
considered. 

2. School size: 

The school size was deteriLlned by the number of sixth 
graders administered the Comprehensive Tests of Basic 
Skills in r^''. 

3. Socioeconomic status of the students: 

From the pupil information section of 'the state Entry 
Level Test , a school Index was determined ':rom the average 
father's occupation. 

A. Percentage of minority enrollments: 

Percentages for minority categories— American Indian, black, 
Asian Ameri^-^ , Spanish-surnamed American, and other—vere 
obtained from the state Entry Level Test . 

22 
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5. School locality: 



The elementary school questionnaire contained a list of 
nine categories used by principals to describe their 
schools • These nire descriptions were then condensed into 
the iollowing three categories: city, suburban, and rural. 

The combination of these f:ve variables together with scores on the sixth 
grade Comprehensive Tests of Basic Skills were used as the selection 
variables. 

The component scores from tha Comr rehensive Tists of Basic Skills * were 
then weighted and used to fnrm criterion variable T for each school in the 
following proportions: 

T - 8 (reading) + k (language) + 2 (spellin£) + 7 (mathematics) 

The regression equation included certain predictor variables: (1) an 
index of socioeconomic st. as; (2) the percentage enrollment for each of five 
racial-ethnic categories (American Indian, black, Asian American, Spanish- 
sumamed American, and other); (3) an index of bilingualism; and (4) the num- 
ber of sixth gradeis taking the sixth grade achievement test. A preliminary 
analysis of achievement and predictor variables led to creation of the 
following strata: ('.) three levels of urbanism (city, suburb, rural); (2) 
three levels of socioeconomic sta^^s (high, medium, low); (3) three levels of 
total percentage minority enrollment vdgh, medium, low), and (A) three levels 
of s.,hool si2e as measured by the number of sixtn graders taking the tests 
(high, medium, low). 

The three levels of urbanism contained unequal numbers of schools. Each 
of other factors, however, was divided into levels containing approxi- 
mately the same .number of schools. Considered together, the stratification 
provided 81 (3x3x3x3) disjoint classifications of schools. 

Regression equations were run separately for 1972-73 and 1973-74. These 
equations were separately generated for each of the two years to ensure* con- 
sistency of performance of the schools identified for study. 

In each year one regression equation was calculated for each of nine 
classifications created by the cross configuration of the three levels of 
urbanism (city, suburban, rural) and the three levels of total percentage 
minority enrollment (high, medium, low). Preliminary analysis revealed both 
a curvilinear relationship between achievement and total percentage minority 
enrollment ^^nd different structural relations between criterion and predic- 
tors in the three urbaniam settings. In general, student achievement was 
positively related to socioeconomic status and negatively related to both 
bilingualism and total percentage minority enrollment. Achievement tended to 
be higher in suburban schools than in city schools and higher in city schools 
than in rural schools. 

Although much variation in achievement existed within the suburban and 
city schools, the rural schools were relatively more homogeneous in achieve- 
ment. School size bore only a weak and inconsistent relationship to achieve-* 
ment; in the analysis, it served primarily as a weight for residuals.* 
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Residuals from predicted scores were used to create separate pools of 
very high-achirving and very low-achieving schools for each of the nine 
regression equations for both years. Paired schools were substantially sim- 
ilar for each of their predictor variables but extremely dissimilar in their 
student achievement. A low score on one predictor variable was not used to 
compensate for a high score on another predictor variable. 

Schools were selected in such a manner that pairs of schools were drawn 
from 19 of the 81 r^ssible classifications of schools. The selection of the 
19 classifications was based on a compromise between representing the "average 
school" and representing the broad variety of schools in California. The num- 
ber of pairs of schools in each level of the background factors is presented 
in Table 

Although the , original design had called for 24 pairs of schools, only 21 
pairs were studied. One pair was not included because one of the schools in 
the pair had been closed; a second pair, because an error occurred in selec- 
tion; and a third pair, because a principal . declined to participate. 

Scores on the Comprehensive Tests of Basic Skills subtests were used as 
criteria to select schools for inclusion in the School Effectiveness Study. 
The 42 schools selected covered the full range of values for each of the 
selection variables — school size; type of location; ethnic make-u^:; and 
parental income. However, while the two schools within each pair were identi- 
cal for each of the selection variables, they were divergent in their achieve- 
ment scores on the Comprehensive Tests of Basic Skills subtests. 



TABLE 

Number of Schools, by Factor and Level 



Factor 


Number of 


pairs of schools in each level 




Low (small) 


Medium (mid) 


High (larRe) 


SES (father's 
occupation) 


9 


6 


6 


Urbanism* 


4 


7 


10 


Minority 

representation 


7 


6 


8 


Size of school 


6 


7 


8 



For this variable only, low - rural; medium - suburb, high - city. 
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B. Corroboration of Achieve int Scores 
Used for School Selection 



Although standardized, norm-referenced achievement tests yield a sound 
assessment of achievement, they do so only within the limited dimensions of 
any norm-r#ferenced test. At the outset no other achievement criteria were 
used; hence the school's characteristics reflect only rather nar.ow achieve- 
ment criteria. Furthermore, principals had previously been informed by the 
California Assessment Pro^^tam of their school's sixth gra^t^ achievement 
scores. Thus the principals knew whethe:- their obtained scores were above, 
at, or below the score that would be precicted for them on the basis of 
their school's background (demographic) characteristics. This information 
may well have influenced the principals' responses to several questions in 
this study. To the extent that principal:; passed this information on to 
teachers, the teachers' responses may also have been influenced. Conse- 
quently, a legitimate concern existed as to whether and how much principals 
might have been influenced by the knowledge of their school's actual achieve- 
ment test results while they assessed the qualities of their sixth grade 
achievement tests. For example, principals at higher-achieving schools did 
rate the test as a more accurate assessment of their students' academic 
skills than did principals of lower-achieving schools. 

Principals were also asked to describe the preparation that preceded the 
sixth grade testing. In general, the descriptions indicated that preJJaration 
for the test tended to be better at higher-achieving schools than at lower- 
achieving schools. Of the 11 items used to question principals about prepa- 
ration, four items showed statistically significant differences between 
higher- and lower-achieving schools. At higher-achieving schools certain 
tasks were generally carried out more efficiently than they were at lower- 
achieving schools: (1) administrative instructions supplied by the state 
were followed precisely i (2) teachers were familiarized with the test before 
it was administered; (3) time limits were closely adhered to; and (4) dis- 
tractions and interruptions were kept to a minimum. 

To corroborate distinguishing higher- and lower-achieving schools on the 
basis of the achievement test scores, researchers made a number of checks. 
The first check was a series of observations conducted at the sampled schools. 
Observation teams were, used consisting of four persons — one employee from the 
State Department of Education and three administrators from school districts 
and offices of county superintendents of schools. The teams met with the 
principal, several teachers, and other school personnel in each of the schools 
sampled to gather information and complete six questionnaires and interview 
guides. 



The -observers were not told which schools were the higher-achieving ones 
and which were the lower-achieving ones, nor were they told which schools were 
paired. At the end of their two-day visit, observers were aske* to assess 
whether the school they were visiting was higher-achieving or lower-achieving 
and their degree of confidence in that decision. Their judgments are dis- 
played in Table III-2. 
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A substantial nurv (73 percent) of the observers were nble to jud^e 
correctly, but fewer than half of the ob<?ervers (A5 percenv) were both corre-t 
and highly confident in their opinions. Although the estimates were signifi- 
cantly above cbance, total agreement on the student achievement -based classi- 
fication of schools as higher-achieving or lower-achieving was lacking. The 
school selection procedure was additionally strengthened by an analysis -vhich 
cl**arly showed that the incorrect judgments were not the result of bias. 
Ra^.ier, they were spread randomly throij^hout the entire distribution of schools 
and observers* ^ 

Besides these observations, another check was conducted to ensure that 
achievement scores were valid criteria for selecting schools in which to 
measure school effectiveness. This check, which was made by the use of 20 
photographs taken at each school, should be interpreted with some caution be 
cause the photograph formats lacked a high degree of consistency. In the 
analysis phase, photographs of five pairs of schools were displayed on poster 
boards. Forty-one professional educators were asked to view the photographs 
and indicate which school in each pair was lower-achieving. Fifty^one percent 
of the responses \'ere correct. In addition to the educators, 150 students from 
the sixth grade of a typical elementary school vlev€d the sane photographs and 
were asked to indicate the school in each pair which they would prefer to 
attend. Sixty-nine percent of their choices were higher-achie*/ing schools. 
The educators* responses were not significantly above chance, but the students' 
choices were significantly above chance. 

On the basis of an analysis of several indicators of quality fc,chooling, 
it was concluded that the test score criterion was, in fact, appropriate for 
determining schools which represented prototypes of successful or unsuccess- 
ful schools. For example, in terms of school ratings, observers were able 
to judge the achievement characteristic of schools on the basis of their obser- 
vations to a degree that was significantly above chance. In \ more limited way, 
the tise of photographs also tended to corroborate the selection of higher- id 
lowet -achieving schools on the basis of test scores. In short, the high de; ee 



TABLE "^11-2 

Observers' Judgments of Achievement Status, by Confidence Level 





Judements 


Confidence level 


Percent correct 


Percent incorrect 


Low 


28 


18 


High 


45 


9 


Total 


73 


27 
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of correlation between the independent and dependent variables adds weight to 
the use of achievement scores for categorizing schools. 

C . Instrumentation 

With our selection of schools accomplished, we then designed eight instru- 
ments to be used in analyzing the effectiveness of the sample schools. The 
eight instruments used in this study are as follows; 

• Principal questionnaire : Describes certain school characteristics; 
primarily demographic in nature (This instrument is not, described 
fi'rther in this section.) 

» Teac h er questionnaire Jci,cribes teacher attributes, such as age, 
training, and teaching style (TrMs instruirent is not describv^J 
furtner in this section.) 

P rincipal interview : Describes principal's perceptions of school 
practices and administrative structure 

ieacher interv iev: Describes teacher's perception of school 
practices, policies, and professional satisfaction 

Classroom observations (based on Madeline Hvinter's work): Describes 
classroom interactioa.-and teaching style 

Photographs of school environ ment: Recorus descriptive inforraation 
regarding pictures taken on site 

Fisca] datgi : Records fiscal and resources Information 

Judgment : Records on-site observer's opinion of -whether the school 
was higher-achieving or lower-achieving and the factors leading to 
this conclusion 

^ • Principal and X^.^cher Interv iews 

In the fall of 197A, one of several four-person teams visited each school 
being studied, observing classes and interviewing., principals , teachers, and 
other school personnel to collect information wfiich might explain school 
effectiveness. These teams paid particular^rfttention to the areas of adminis- 
trative and instructional practices, fiscaj^ policies , perceptions of influence 
on decision making, and general school environment. The visitation teams, 
whose members were drawn from the State /epartmenc of Education, school dis- 
tricts, and offices of county superintendents of schools, were informed of 
neither the achievement level of various schools nor their pairing. 

before visiting the schools, each^team member particirsted in a two-day 
training conferee • e on use of the instruments. The visitation teams subse- 
quently recorded e responses of 250 teachers, '^2 piincioalf, and other 
school Dersonnel. Observprs interviewed the school prtnc^pai ^^rid as many as 
ten teachers at e^ch school durinp the two^da/ sciinox vis^r^.^ion pcrlou. The 
only criterion for interviewing either a principal' o* a te ner was that the 
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principal or teacher had been a part of the educational process chat had led 
to the school achievement scores of 1972-73 and 1973-74. In several in- 
stances fewer than ten teachers were Interviewed because teacher turnov*;r had 
been great or the ''chool had a small number of teachers. 

2. Classroom Observations 

Each observer received a separate copy of a classroom observation record 
for each teacher interviewed. During either the reading or mathematics 
periods, the observer was to monitor the teacher's instructional style and 
rate both the teacher and his or her method on each of 17 scales • Then an 
overall rating was to be made within the same rang^e. To measure interobserver 
agreement, team leaders made a second classroopi observation of a teacher who 
had been observed by another team member. Fifty-nine teachers were observed 
and rated on 12 items. Because the two observations did not occur at the 
same time, they do not represent two observations of exactly the same •'eacher 
behaviors or classroom configurations. The relatively strong correlation 
between the two observation measires, therefore, ia a composite of both inter- 
observer consistency and the consistency of teacher quality and classrocu 
interaction patterns over a period of time. 

3. Photographs ot School Environment 

Twenty photographs were taken at each school. The plan called for the 
examination of slides by a jury of ^'experts" who would attempt to detect 
attributes in che photographs which differentiate between the two schools of 
a pair. Unfortunately, little consistency occurred in the photographs taken; 
and the photographers were not equally skilled in taking candid, unobtrusive 
photographs. Although the photos proved helpful in corroborating test scores 
IS criteria for school selection, they proved lo be of limited value in 
determining the features of effective schools. 

4. Fiscal Data 

One member of each visitation team was an expert in the fiscal manage- 
ment of school districts. In their attempts to collect fiscal data at the 
school-site level from school dist^^ict offices and school records, the fiscal 
observers found two major problems in several schools. First, in rany in- 
stances, school district and school-site financial data were not available. 
(The original research design had called for a five-year longitudinal study 
of school-site expenditures.) Secondly, althc^igh districts follow the 
California School Accounting Manual (Sacrkmento: California State Depart- 
ment of Education, 1976) at the district level, many different procedures can 
be followed for fiscal accounting at the school level. For example, ^ 'strict 
maintenance expenses are rarely available as school-site costs of maintenance. 
Because of the la<;k of consistency in recordkeeping practices at the school 
level, several variables have been excluded from consideration as potential 
cc.j discriminators. Only seven of 33 measurements were collectible from 
only 12 of the 21 pairs of schools. Consequently, the analysis of fiscal 
data, severely limited, was eliminated. 
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5. Judgment 



r»t.A \ f t'^-day visitation period, each observer indt- 

TrJ'i u ^''^ ^^^gh^'^- °- lower-achieving 

group. The observer was to use any clues received in the course of Interviews 
and observations. These clues and any information which the observer used in 
arriving at a decision were recorded. 

6. Analysis 

By means of a variety of techniques, the data contained in several 
instruments were analyzed. Tables were displayed to facilitate comparison of 
higher-achieving and .ower-achiev-ing schools i.o trace each comparison across 
background factors. All scaled items were analyzed by the analysis of vari- 
ance* met od; all nonscaled items wer6 analyzed by the chi-square method. 
Related items were analyzed in either of two aggregate forms: some variables 
were combined to create new compound variables; others, mort loosely associ- 
ated, were combined in vectors for multivariate analysis of variance. 

Items taken from the teacher questionnaire, teacher interview, and class- 
room observation instruments received multiple responses in sach school. 
These items were analyzed in both a univariate and multivariate analysis of 
variance, and planned comparicons were used throughout. The layout of the 
design was two levels of achievement by three levels of SES by three levels of 
urbanism by three levels of percentage minority. Items on the principal 
questionnaire and principal interview instruments had single responses in e-h 
school. These items were analyzed by means of matched pair t-tests and ch^ 
square contingency tables. To rontrol the overai experimental -rror rate, 
the researchers conducted hypr ,nesis testing at the level of a - .05 per 
.family of hypotheses. 

% 

D. Summary of the Chapter 

The description of the research design, methodology, instruments, and 
analysis is intended f^r the use of researchers weighing the merits of the 
study while pursuing the study of school effectiveness. The genetal design 
and sample selection procedures of the study are particularly strong. By the 
use of the large pool of data available through the California Assessment 
Program, careful selection has been made of a set of schools in which the 
match of background factors between higher- and lower-achieving schools within 
a pair very close and the entire range of schools in California is represented. 

Another distinct advantage of this study is its use of on-site visitation 
and observation in addition to more standard data collectioa methods. As a 
supplement to the information provided in Chapter III and Chapter IV, a set of 
tables displaying the various analyses is presented as Appendix A. Additional 
information any of these areas is available on request. 
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Chapter IV 
Findings and Discussion 



The findings and discussiori contained in this chaptcJr sre based on infor- 
mation obtained in the first year (1974-75) of a two-year study of school 
effectiveness in California. The primary findings of the School Effectiveness 
Study fall into four major areas: 

• Staff characteristics 

• Measures of contact between students and staff 
Instructional and organizational processes 

• Miscellaneous findings 

For a clear understanding and use of the findings as they are presented 
in this chapter, certain precautions are recommended. The first is that, 
because additional research will be conducted in the areas studied, the find- 
:*ngs ought to be viewed as preliminary. Secondly, the findings contain infer- 
ences drawn from natural variation among schools rather than the planned 
variation of a controlled experiment. An<* thirdly, because the inferences are 
drawn from natural variation, the activities and personnel observed in the 
lower-achieving schools imy not be responsible for the low scores* Rather, 
the observed activities and personnel may represent changes ^introduced to 
overcome the initially low scores. This second possibility is an alternative 
hypothesis which becomes more plausible because lower-achieving schools have 
reported an increased number of personnel and curricular changes in recent 
years. However, the hypothesis becomes less plausible in view of the some** 
what lower current achievement scores of the lower-achieving schools. The 
three recommended precautions should be seriously considered before any con- 
clusions affecting policy are drawn from this study. 

The sample schools were chosen very carefully, and the data were col- 
lected from systematic observation and measurement of practices and character- 
istics of the schools. The researchers interfered little with the schools' 
normal routines. Consequently, the findings and the methods used to obtain 
them will be useful in further research into school effectiveness. 

Certain other clarifications also need to be made. For example, when the 
report refers to higher-achieving schools as having a characteristic tc a 
greater degree, two inferences are to be drawn: (1) that the comparison 
group is the set of lower-achieving schools; and (2) that the comparative 
phrase invariably means **to a degree that is statistically significant." In 
adc'ition, these differences are the basis of specific statistical tests for 
the various items described in Chapter Hi. When, for example, principals at 
higher-achieving schools report more experience, what is meant is that (1) 
the principals report more experience than do principals at lower-achieving 
schools; and that (2) the expedience differential is statistically significant 
and could not have occurred by chance in more than five out of 100 cases. 




The basic comparison throughout the study, then, is between higher- and lower- 
achieving schools, and the basis of this comparison is a statistically signif- 
icant difference. What follows is a series of discussions of the findings 
under the fotir main areas of staff characteristics, contact between students 
and staff, instructional and organizational processes, and miscellaneous 
findings. 



A. Staff Characteristics 



In general, in higher-achieving schools principals and teachers agreed 
more frequently on the locus of influence within the school as well as on 
ratings of several criteria of effectiveness and personal job satisfaction. 
A comparison of teachers' and principals' responses showed more agreement 
between principals and teachers about the locus of influence over a variety 
of school-level decisions at higher-achieving schools. Overall, both princi- 
pals and teachers at higher-achieving schools gave one another higher rctings 
on several criteria of effectiveness and reported a higher level of personal 
job satisfaction thar did principals at lower-achieving schools. 

1 . Principals 

because principals are the highest administrators at the school level, 
they appear to be an appropriate starting point for analyzing staff charac- 
teristics. In this study priniripals at higher-achieving schools reported 
having rauch more experience as principals at their schools (mean 8.1 and 2. A 
vears, respectively) and being generally mors satisfied with their position as 
principals. The principals in nigher-achieving schools were also paid slightly 
higher salaries than were principals at lower-achieving schools, but the 
higher salaries might be explained by their longer tenure at the schools. No 
differences in principals' years of experience at their schools appeared 
across levels of socioeconomic status, percentag,e of minority enrollment, or 
urbanism. Principals of higher- and lower-achieving schcols did not differ 
significantly in median age (forty-nine) or highest academic degree (master's 
degree) . 



Principals at higher-achieving schools were assessed by their teachers 
as having more influence o^/er decisions affecting curriculum development and 
the hiring of teachers and paid aides. Teachers at higher-achieving schools 
rated their principals higher both on general performance standards and on 
specific standards of helpfulness— supporcing new ideas and projects, backing 
up teachers, enhancing parent-community relations, enFiarclnf^, discipline, 
dev loping instructional leadership, and acquiring and distributing materials. 

2 . Teacher s 

Status characteristics of teachers also differed between higher- and 
lower-cichievlng schools, although often not to a statistically significant 
degree. More female teachers than male teachers were employed in all school?,. 
Mai,- teachers comprised 11 percent oi the faculty in hi}?.her-achievement 
schools and 22 percent of the faculty in lower-achievemenL schools. This 
two-to-one latio held consistently for the three levels of SES and for the 
three levels of percentage minority enrollment. 
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In comparison wit^^ teachers at lower-achieving schools, teachers at 
higher-achieving schools reported being slightly oHer (median age forty-two 
versus thirty-nine) , having more years of teaching experience (median eleven 
versus eigiit years) , and having obtained more college credits since beginning 
teaching, although no significant difference was report d number of college 
credits in reading courses. As with principals, teachers at higher-achieving 
schools were paid slightly higher salaries; but the difference might well be 
explained by their longer tenure in teaching at the schools and their greater 
number of college credits. 

Teachers in low socioeconomic status (SES) schools reported being slightly 
older than teachers in either high-SES or mid-SES schools. Teachers at schools 
with a high percentage of minority enrollment reported a median age of forty- 
two in comparison with teachers at schools with mid- ana low-percentage 
minority enrollment, who reported median ages of thirty-eight and forty^ 
respectively . 

Teachers at higher-achieving schools believed that their faculty as a 
whole had less influence on school-level decisions affecting teacher hiring 
and administrative methods of teacher evaluation. It appeared that teachers 
at higher-achieving schools, in general, perceived the influence of their 
faculty as a whole to ba less than the ^^'^ulty influence reported by lower- 
achieving schools. 

No significant differences appeared between higher- and lower-achieving 
schools on teachers' responses to items regarding their willingness to be a 
leader or share ideas and teaching tasks with others. Teachers at higher- 
achieving schools, however, reported being more satisfied with various aspects 
of school than did teachers at lower-achieving schools, particularly as to 
their work relationships with the principal and othrr teachers, teacher evalu- 
ation, and their rolas as teachers. 

3. Counselors and Specialists 

More than half of the schools studi d reported having counselors on the 
staff. Althougn among low socioeconomic status (SES) schools, the lower- 
achieving schools had more counselors; among high-SES schools, the higher- 
achieving schools bad more counselors. In general, tnough, no relationship 
was discernible between achievement and the employment of a counselor. 

In addition to regular classroom teachers, other certificated personnel 
teach students. Because they have special training and licensed or teach a 
specially identified population of student^, they are classified as specialist 
teachers. One difference did emerge quite clearly in this analysis. Unlike 
the reading specialists in lower-achieving schools, specialists in highev- 
achieving schools spent relatively more time teaching students directly anc^ 
relatively less time Instructing teachers in specialist techniques. 

4. Pai ^ Aides and Volunteers 

In total, 640 paid aides and adult volunteers were reported in th« study. 
No appreciable difference appeared between higher- and lower-achieving schools 
as to the rj^ber of such persons they reported (an average of 1.9 and 1.8, 
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respectively, per teacher,. The number of paid rAdes and adult volunteers (the 
il.tinction between the two categories is based on renumeratlon and traininp) 
J. expressed in Table lv-1 on a per teacher basis for high, middle, and low 
ita and tor higner- and lower-achieving schools. The data in Table IV-1 are 
displayed to illustrate the number of oaid aides and volunteers by a common 
siandard—nutnber of aides and volunteers per teacher. It is not implied that 
tnc numbers represent their actual assignment at tl.e school level. 

Higher-achieving scnools had slightly fewer paid aides than did lower- 
achieving schools. On the average, low socioeconomic status schools had twice 
o any paid aides per teacher as did mid-SES and hlgh-SES schools. 

As to the distribution of ^ ult volunteers, higher-achieving schools had 
sligntly more of them than did lower-achieving schools, and both high-SES and 
low-SES schools had twice as many aduU volunteers as did mid-SES schools. In 
addition, within the group of low-SES schools, the higher-achieving schools 
did have more adult .jluntt .rs (1.4 per teacher) than did the lower- 
achieving schools (0.6 per teacher). In contrast, within the ^roup of high- 
bEb schools, higher-achieving schools had fewer adult volunteers (0.8 per 
teacher) than did lower-achieving schools (1.4 per teacher). 

Teachers were asked to indicate how paid aides and adult volunteers were 
used in terms of several types of functions they might perform. The teachers 
in higher-achieving schools reported usinr aides significantly more for 
watching children on the playground, handling classroom paperwork such as 
keeping attendance and recording student work, and helping to maintain class- 
room discipline. They reported about the same use of aides in teaching aca- 
damic subjects, tutoring individual stuients, and teaching small groups. 

^- District Administration 

Teachers from higher-achieving schools reported that personnel in their 
district had more influence over curriculum and teacher hiring. In appraising 



TAj^LL IV- 1 

Number of Paid Aides and Adult Volunteers per Teacher 
by Achievement Status and SocioeconoTnic Status 



Achievement 


Type of 


Number of personnel 
by socioeconoT.ic status 




status 


personnel 


Lo*/ 


Middle 


Hl^h 


Weighted average 


higher-achieving 
schools 


Aides 

Volunteers 
Total 


1.5 
1.4 
2.9 


0.5 
0.6 
1 . 1 


0.7 
0.8 
1.5 


1 .0 
1 .0 
1 .9 


Lower-^achieving 
school? 


Aides 

Volunteers 
Total 


1.3 
0.6 
1.9 


0.7 
0.5 
1 .2 


0. 7 

1. A 

2.1 i 


1 .0 
0.8 
1.8 
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the performance the districts' central administration, teachers from 
higher-achieving schools rated the administration higher in instructional 
leadership and allocation of materials and resources, equal in support for 
teach.ng staff and attendance and discipline of students, and lower in 
effecting group involvement in school decision making. 

6. Agreement between Principals and Teachers 

On the one hand the principals from lower-achieving schools reported 
greater influence over teacher hiring than did principals from higher- 
achieving schools, but on the other hand, the teachers from lower-achieving 
schools reported the' .eir principals had less influence over teacher hirir»g. 
Similarly, teachers liom lower-achieving school . reported the^nselves as having 
more influence over teacher hii ^ing than did teachers from higher-achieving 
schools; but the principals from lower-achieving sciiools did not support that 
contention. In comparison with teachers from hi^her-aciiieving schools, teachers 
from lower-achieving schools generally reported themselves and their teachers* 
organ? ?:ations as having ore influence over decisions concerning hiring, 
assignment, and evaluation of teacners. Teachers at higher-achieving schools 
rated their principals higner on each of the six criteria they were asked ~o 
use. These teachers also responded more positively regarding their relation- 
ships with their principals. 

7. Faculty MeetinF>s and Inser.ice Traininj'^ 

Principals from lower-achieving schools reported having more faculty 
meetings per month than did principals from higher-achieving schools. Ihe 
frequency of faculty meetings also appeared to be related to the background 
characteristics of students, with low-SES schools having more faculty meetings 
than did high-bES schools. 

Principals from higher-achieving schools reported more district encour- 
agement of inservice training in the form of either payment of teacher 
expenses for inservice training or an award of credit on salary schedules for 
that participation. The degree of district encouragement appeared to be 
related to school achievement and level of SES ; a relatively greater degree of 
encouragement uas reported in the higher-achieving schools among low-SFS 
schools and in the lower-achieving schools among high^SES schools. 

Nearly all schools reported that special training was provided to help 
teachers learn to use some reading materials. In comparison with principals 
at lower-achieving schools, the principals at higher-achieving schools 
reported that less special training was provided for the mathematics materials 
(57 percent versus 92 percent). Differences were also reported regarding 
both the trainer and the format employee in the training; hipher-'achievin^ 
schools reported the use of relatively nore district personnel and fewer 
outside consultants. ^They also reported having relatively nore short-term 
workshops and fewer ongoing inservice training and special presentations. 
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. lleasures of Contact Between Students and Staff 



1 • Use of Class Time 

For the initial assessment of measures of contact, only estimated time 
spent in class rather than observed contact time has been measured. The esti- 
mated time spent in class was obtained by asking teachers to indicate the 
amount of class time spent weekly on typical elementary subjects. Observed 
contact time would have required extended observation and analysis of specific 
teaching activities. 

Teachers' responses are shown in Table IV-2. In comparison ','ith teachers 
at lower-achieving schools, tejachers in higher-achieving schools reported chat 
they spent relatively less total time in classroom Instruction; more time on 
social studies, less time on mathematics and physical education/health; and 
about the same amount of time on reading/language development and science. 
Absolute differences between higher- and lower-achieving schools varied only 
slightly batween social studies (.3 hours' difference) and re^^dlng (.1 hours' 
difference); yet a statistically significant* difference occurred between 
groups in the former category but not in the latter category. 



TABLE IV-2 

Class Hours per Week, by Subject Area 
and Achievement Status 





Class hours, bv achievement status 


Subject area 


Higher-achieving 
schools 


Lower-achieving 
schools 


Reading/ language 
development 


9.5 


9.6 


Mathematics 


A. A 


4.8 


Science 


1.9 


2.0 


Social studies 


3.1 


2.8 


Pnystcal education/ 
health 


2.2 


2. A 


Other 


3,0 


3.1 


Total 




24.7 
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After the results were tabulated, schools were coutacted to verify the 
derived estimates of total time. The school schedules confirmed the total 
time estimate shown In Table IV-2. The seemingly small hourly differences 
between higher^ and lower-achieving schools were particularly remarkable In 
that the Education Code does not mandate (or even suggest) appropriate Instruc- 
tional time for any subject except physical education (see Education Code 
Section 8551). (The Education Code does specify a minimum number of hours and 
days that classes must be In session eacb yeai.) Both the jack of direc- 
tive and the aforementioned lack of bias make the findings regarding the 
length of time of instruction in mathematics and social studies particularly 
Interesting. 

The finding that students in lower-achieving schools receive signifi- 
cantly more instruction in mathematics than do those In higher-achieving 
schools prompted a reexamination of the criterion variable used in classify- 
ing schools as higher- and lower-achieving. A suspicion that the particular 
w^^ghtlng of component scores used in forming the criterion might have caused 
a distortion proved to be unfounded; the higher-achieving schools had 
relatively higher mathematics component scores than did the lower-achieving 
schools . ^ 

2. Summer School Attendance 

Another measure of contact between students and staff was summer school 
attendance. Observers polled several classrooms of students at each school 
to ascertain this information. The results are displayed in Table IV-3. 
Although a larger percentage of students from higher-achieving schools indi- 
cated thac they had attended summer school, the more important variation 
appeared between socioeconomic levels. 



TABLE IV- 3 



Percentage of Students In Attendance at Sun^me^ School 
by Socioeconomic Status and Achievement Status 





Percentaga of student attendance 
by achievement status 


Socioeconomic status 


Lower-achieving 
schools 


Higher-achieving 
schools 


Low 


17 


39 


Medium 


36 


46 


Hlp.h 


36 


28 


Weighted average 


28 


38 



See Chapter III for informatior on the achievement criterion variable and 
the weighting of component scores in the formation of the criterion. 




C. Instructional and Organizational Characteristics 
1 • Instructional Styles 

Teacher quality and classroom atmosphere were rated significantly higher 
by observers in higher-achieving schools. Observers rated t-acher quality 
according to certain characteristics. Included were teachii to an objective 
at an appropriate level of difficulty; effectively monitoring student progress 
in lessons and adjusting appropriately; and facilitating the learning process 
^- applying well-established principles of learning, such as motivation, to 
get students started on their lessons. Also included were recognition of 
United attention spans and positive encouragement of good work habits. Oper- 
ationally, classroom atmosphere was p combination of items on the observation 
instrument which described student self-reliance and the general tenor of the 
classroom. 



In general, observers perceived students at higher-achieving schools to 
have more opportunities to decide for themselves about varying their tasks 
and activities. There were fewer gaps or delays in stuaent classroom activ- 
ities. Students were perceived to be happier, more engaged in their work, 
and less disruptive, restless, or bored. Although students in higher-achieving 
schools showed these traits, the rates of absenteeism in higher-achieving 
schools did not differ substantially frum the rates in lower-achieving schools. 

In an attempt to measure the reliability of information obtained from 
classroom observations, 59 teachers wera observed on two different occasions, 
once Dy a team member and again by a team leader. The correlation between 
the observer rating for the total score for 12 items from the classroom obser- 
vation instrument was 0.65, a moderately strong agreement considering that the 
observations were made independently and at different times of the day. 

2- Group Assignments and Pacing of Instruction 

Among the first -uestions asked about instructional processes were two 
related questions which dealt with the criteria for forming groups for read- 
ing and mathematics instruction and the racing of studeats within those groups 
In response to the former question, teachers in higher-achieving schools 
reported placing more emphasis on students' academic performance in both 
subject.. The results of the latter question, related to pacing, are dis- 
play!. In Table IV-A. 

Although the great majority of tea'ihers reported the use of different 
pacings and more than one grouping, significant differences were reported 
between higher- and lower-achieving schools. Teachers in higher-achieving 
sch- Is divid'id their classes into several groups working at different paces; 
teachers at lower-achieving schools more frequently reported individualiza- 
tion of instruction. The reasons for this finding are far from clear; the 
data are based on what local schools describe as "individualization" combined 
with some direct observation. The first-year data have not been assessed 
well enough to determine the extent of actual implementation of individualized 
instruction. 
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Placement and Evaluation of Students 



Principals were asked several questions concerning possible criteria for 
the placement of students In reading and mathematics classes. The principals 
in hlgher--achlevlng schools indicated that for both reading and mathematics 
placement, more Importance was given to the results of standardized tests and 
other commercially developed tests and less Importance to the results of 
teacher--made tests, classroom performance, and teacher recommendations. This 
pattern, which distinguishes principals' reports for higher- and lower- 
achieving schools, remained fairly consistent for all levels of SES and all 
levels of minority enrollment. 

Variation in Materials 

Teachers were also asked to Indicate how much variation there was in the 
materials their students used. The results are displayed in Table IV-5. 

As with pacing practices, teachers in higher-achieving schools responded 
chat they divided their class'^.s into fewer groups and correspondingly used 
fewer variations in materials. By contrast, teachers at lower-achieving 
schools reported far more frequently either that all students used the same 
materials or that each student used different raaterials. 



Jf^ E IV-4 

Percentage Distribution of Pacing Practices 
by Subject and Achievement Status 



Pacing practices 


Percentage of aistrJbution 
in mathematics instruction 


Percentage of distribution 
in reading instruction 


Higher-achieving 
schools 


Lowe ^-achieving 
schools 


Higher-achieving 
schools 


Lower-achieving 
schools 


One group; 
same pace 


9 


9 


2 


4 


Two or three 
groups ; 
different 
paces 


41 


25 


36 


25 


Four or more 
groups; dif- 
ferent paces 


27 


23 


41 


33 


Individuali- 
zation 


22 


43 


21 


38 


Other 


1 


0 


0 


0 
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nh«/ differences in pacing might be related to curricular differences 
TiZTll principals regarding changes over the past five ye^rs in 

either the mathematics or reading curriculum. Higher-achieving schools ^e- 

of": n^rirb^t^^'^"':' lower-achieving schoo'l. re or^Id^a' it a e -unt 
ot change in both curricula. Either the recctmnenH^J method of using the new 

ioLhlo°H T"'" '^'^ familiarity with the.- .,y be related o'tJe rell- 
tionshio between lower ac'.ievement and greater incividualization. 

5« Teacher Organizations 

assess"rhp'r^'' of questions, both principals and teachers were asked to 
assess the degree of influence various parties (district personnel, prin- 

catlo^ l^L on''' '"r''' organizations) involved in iocal edu- 

cation had on a variety of decisions (curriculum .^.lection, determination of 

mett eva '%r' ^^^^^^^ hiring, principal and teacher assign- 

ment evaluation ot teachers, and paid aide hiring). The rationale for the 
questions was the belief that the influence of thfs. parties o"r decision 
making might be different in higher- and lower-achieving schools. One finding 
that was consistently reported was statistically significant- tLr T. ll.u 
teachers and principals fro. higher-achieving scho S e^o^ ^d ^eLh ;s' ' 

™rTZ\T- ""rr T ^^^^^^ °' teachers J a" did 

teachers and principals from lower-?chlex _ np schools. 



TABLh IV-:, 

Percentage Distribution of Variation in Materials 
by Subject and Achievement Status 



Variation in 
materials 


Percentage of 
m ma thematic 


distribution 
s instruction 


— * 

Perec itage cf distribution 
in reading instruction 


Higher-achieving 
schools 


Lower-achieving 
schools 


Highe? ichieving 
schools 


Lower-achieving 
schools 


One gr .up; 
same 

materials 


24 


1 3, , 


11 


26 


Two or three 
groups ; 
different 
materials 

1 


4A 


28 


A3 


29 


^our or more 
gt' ip^ , differ- 
enL materials 


27 


20 


39 


28 


Individuali-- 
zation 


5 


v. 


7 


17 
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D. Miscellaneous 

1 . Rules and Regulations Governing Student Conduct 

Teachers were asked several questions about classroom rules, student con- 
duct » and student discipline; but no significant differences materiplited 
between higher- aud lower-achieving schools. No signiticant differences 
emerged in classroom rules or student conduct or discipline when levels of SES , 
percentage of minority enrqllment, and urbanisrn within the higher- and lower- 
achieving groups were examined. Nor was any difference reported in either the 
emphasis these schools placed on rules affecting student behavior or in the 
district policies o|> student conduct. 

However, teachers at higher-achieving schools did rat" their principals 
higher in support in natters of student discipline. Principals' responses 
indicated that it was easier for a student co be transferred from one teacher 
to another to resolve a conflict in a hip,her-achieving school than in a 
lower-achieving schoal. Generally, teachers in higher-achievinp schv/ols 
viewed parents as having more influence in the schools, oarticularly as to 
decisions on student assignment and school rules and regulations. Parental 
influence was reported to be only weakly related to high p .hievement among 
low-oES schools but strongly related to high achievement amon^ lUid-SES and 
high-SES schools. 

2 . Multiple Grade Level Classes 

Most classrooms were composed of students from a single grade level. 
Fewer of the classes in higher-achieving schools were composed of students 
from mul 'pie grade levels than were classes in lower-achieving schoo]*; ''29 
j^ercent and 41 percent, respectively) . The multiple grade Ijvel class seened 
particularly popular in lower-achieving subrrban schools (55 percent) and 
lower-achieving raral sciiooiG (50 percent) 

3. Accessibi^litv of Materials and Discretion in School Budgets 

Accessibility of materials was reported to be ^^^^^er in higher-achieving 
schools, and greater f^ncher satisfaction with available resources was 
repc ted in higher-achieving schools than in lower-achieving schools. And 
although n.i significantly aifferent, teachers in higher-achieving schools 
reported more access to resources aiTd sharing of materials. Libraries in 
higher-achieving scuools were reported to be somewhat larger than those in 
lower-achieving schools (abou. 6,200 and 5,400 volumes, respectively) . Prin- 
cipals* responses iadicated that no difference existed between higher- and 
lower-a^aieving schools in either the availability of or teacher use of audio- 
visual equipment and instructional materials. 

In comparison with principals in lower-achieving schools, the principals 
in higher-achiiw ving schools reported having more discretion over school 
finances. In obtaining instructional materials, they r?.ported hr ing more 
options in deciding whether to make purchases through central purchasing at 
the district level or c^irectly from stores through a charging procedure or ^ 
pay-and-reimbursement procedure. Nearly twice as many principals at higher- 
cichieving schools reported that decisions could be made at the school site to 
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-onvert certificated personnel positions Intc expenditures In oth-r areas (46 
percent versus 25 percent at lower-achievinj* schools). ^ 

^ • .School ComTnunity 

.h.r/l^"f ^f^^ ""^ '° describe th. school community on scales of four 

characteristics: stable to transient, innovative to traditional, supportive 
to nonsuppo.tive. and ac.ive to inactive. Principals from higher-achieving 
scaools consistently described the scUool community as more stable than did 
the principals from lower-achieving scaools. Among hlg, - and mid-SES schools, 
the prxncioals from lower-achieving schools described the community as more 

^^noilf !; ' Jk'/^^^ '^^^ principals from higher-achieving 

. scaools described the community as more innovative. No discernible difference 
appeared along the supp.rtive-to-nonsupportive scale Nor was there a dis- 
scJ^oL " r'"'' «-^i---to-inact .ve scale among low- and mid-SES 

schools nowever, among nigh-SES schools pr^ icipals from highet -achieving 
schools described tl.e school community as more active than Hid principals 
i.roir lower-achieving schools. ^ 

Summary of the Chapter 

This chap..r contains a summary of the general findings of the Srhooi 
Effectiveness Study in each of fou- major categories. An attempt ha^'bee^ 
r^tSi ^h ' T : fraPework and discuss that framework's place 

V to 1 structure. This disrassion 1 ,s been extended into Chapter 

V to Include a number of conclusions and impli coitions. 
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Chapter V 
Implications of the Study 



As presented in Chapt . IV, the findings of this study provide valuable 
information on the four categories of educational variables which have been 
investigated. Additional analyses of the major factors (including staff 
characteristics, measures of contact between students and staff, and instruc- 
tional practi'tes), as well as the minor factors subsumed under each of them, 
will be undertaken in subsequent research. At the present time, however, a 
number of practices highlighted by this study should be considered by those 
who are responsible for local programs and who are interested in improving 
the quality of educational programs* 

Among the strongest findings of the School Effectiveness Study was the 
importance of te- iher perception of administrative support at both the school 
and school dis " levels. Teachers in higher-achieving schools consistently 
reported that p. ipals ^ave then, greater support ia insttuctionally related 
areas such as pre sion of adequate materials and si port for new ideas and 
special projects, as well as i*^ those areas less directly connected with the 
instructional process, including student discipline and maintenance of relations 
with parents and the community. Equally as important, teachers and principals 
in higher-achieving schools agreed to a greater extent on the locus of power 
and decision making. School district administrative support was also viewed 
as significantly grei>ter by teachers in higher-achieving schools but only in 
areas such as instructional leadership, allocation of resources, and distri- 
bution of materials which are related more directly to the instructional 
process . 

Although information sufficiant to establish a direct link between these 
supportive behaviors an J ' adent achievement may still be lacking, two plau- 
sible alternative hypotheses can be offered. The significant differences may 
indicate teacner satisfaction, which improves the learning climate directly; 
or they may suggest that teachers simply have more time to spend on prepara- 
tion and direct instructional matters because principals and district adminis- 
trators are handling subsidiary matters. Whatever the case, principals and 
administrators who consider high achievement for students to be an important 
factor in the'r schools would do well to concentrate on provid^Jig both a 
stroagly s portive environment and a well-defined blueprint of the respon- 
sibilities and powers of various members of the education community 

A potentially important corollary %p supportive behavior is the issue cf 
teacher influence on school decisions. Teachers In blgher-achleving schools 
rated their teaching faculties as significantly less Influential in a number 
of decision-making areas tnan did teachers in lower-achieving schools. This 
analysis would be remiss if it were to indicate that the correct conclusion 
to be drawn is that teachers should be discouraged from exercising influence 
on school decisions. Rather, it can be assumed that this apparent lack of 
influence is merely a perception of teachers and that It may more likely be 
related to the satisf action which they have expressed regarding principal 
and administrative support for their vork. Such a conclusion is more strong': 



supported when one looks at the absolute value f higher-achieving and lower- 
achieving srhools on this variable. Then it becomes more clear that, although 
teachers in higher-achieving schools perceive themselves as significantly less 
Influential than do teachers in lower-achieving schools, in fact neither group 
perceives itself as very influential. It can also be asserted that the strength 
of satisfaction with administrators, when substantial, is more important than 
feelings of personal influence in determining the overall level of satisfaction. 

Another set of conclusions relates to instructional practices. The School 
tffectiveness Study has shown that very different classroom behaviors are 
exhibited by teachers in higher-achieving schools than by thosp in lower- 
achieving s-hools. From an observation lasting only several nutes, re- 
searchers were able to distinguish ceachers in tne higher-achieving schools 
from those in low^r-achieving schools. Much of that impression was based on a 
purely subjective evaluation. On the other hand, there is some evidence to 
suggest that teachers who were rated more highly were found to monitor and 
adjust to student needs more closely and to teach to a clearly defined objec- 
tive more frequently. However, it will be necessary to define more precisely 
the meaaings and standards for judging such behavior before any definitive 
poll statements can be trade. 

In deterininlng the correct poll-- conclusi-ns which can reasonably be 
drawn from the study, it is most important to view the findings as related to 
one another and to other research studies rather than as standing alone. A 
clear example is provided in the preliminary findings of this study which 
suggest that higher-achieving schools use a moderate number and size of groups 
per classroom and that lower-achieving .ools report more and smaller instruc- 
tional groups. As asserted in Chapter il, other researchers have found that 
the connection between numbers of groups and achievement relates more to the 
increased ability of teachers to monitor a few larger groups of children than 
to any dynamic inherent in group size itself. Therefore, all schools—whether 
>ey provide individualized instruction or not— should consider the importance 
of training teachers to monitor and oversee student learning and progress. 

The data on direct instruction in specific subjects generally remain too 
unst^le for making policy determinations. The only consistently clear pieca 
of information which has developed is the relationship between amount of 
social studies and higher achievement. A significant difference exists in the 
expected direction (that is, more instruction in higher-achieving schools), 
and other recent research seems to highlight this relationship. Policy con- 
siderations would lead to an assertion that it is not social studies instruc- 
tiou per se which accounts for increased learning but the use of social 
studies as another discipline supplementing and complementing reading instruc- 
tion which piakes it an important factor in general achievement. 

No definitive statement can be made at this point regarding the seemingly 
contradictory findings that students in lover-achieving schools receive more 
instruction in mathematics than do students in higher-achieving schools. Any 
venture at a guess would be foolhardy and frivolous at this time; therefore, 
the question must be left open for additional study. 
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In addition to further assessment of the role of instructional time in 
Ina^hematics as related to achievement, study in several other area? is also 
recommended. Further study is recommended of the nature and implementation 
of individualized instruction, with particular attention being given to the / 
quality of adult supervision of children working in the individualized mode. 
Also recommended is the collection of additional information regarding the 
quality and extent of training for aides to supplement our data and additional 
analysis of the summer school data gathered in chis study. All of these 
issues are of primary interest; yet limited resources preclude an examination 
of all of the issues in depth at the present tinie. 

In summary, this -eport contains a description of a number of variables 
deemed significant for affecting student achievement. The extent and impact 
of each variable has been indicated. It is hoped that school administrators 
and teachers will find this work beneficial and useful. In the meantime, the 
Department of Education has found this study useful as a springboard for its 
own research. In the coming ironths an analysis will be made of second-yeflr 
data in an attempt to seek extensions and alternative explanations for several 
of the findings. Additionally, other findings are expecttd to form the basis 
for some of the special studies conducted by the Department's Office of Pro- 
gram Evaluation and Research as part of the consolidated evaluation process. 
For scholars in educa^ion it is hoped that this report will contribute to 
their search for additional variables contributing to school effectiveness. 
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Appendix A 

Further Information on Design and Methodology 

The general design, methodology, flndlnps, and policy recommendations of 
this study have been discussed. In this appendix is presented at^dltlonal 
information more technical in nature for persons Interested in stuf^yinp the 
design and methodology more closely, 

1 • Test Scores 



In Table A-1 we .resent a listing of the sixth-grade achievement scores 
for each of the 21 sampled pairs of schools. For each pair the first sc' ^ol 
is the "above-prediction" school; the second school is the "below-prediction" 
school. 

For each set of schools we nave provided mean scores in reading, language, 
written expression, and spelling for each of seven years. Although the orig- 
inal selection of schools included data in all four testing areas, it used 
only scc--is from the years 1972-73 and 1973- 7A. The remaining years' scores 
are presented for comparison and research. 

In the seven-year span covered in the data, two different tests have 
been used. From 1969-70 through 1973-74, sixth graders were administered the 
Comprehensive Tests of Basic Skills , Form Q, Level 2; and from 1974-75 through 
1975-76, they were administered the Survey of Basic Skills . 

In the listing three pairs of schools— E, T, and X~are not included. 
These represent the three pairs discussed in Chapter III which were eliminated 
from the study after the original selection of 24 pairs. 

Included in several categories of Table A-1 is either the letter M or a 
triple asterisk (***) . The M refers to data which are not available and 
apparently have never been collected. In the early vears of thf» California 
Assessment Program (1969—72), the Department did not send state-developed tests 
to the districts, instead, the local schools were to administer publishers' 
tests and send the results to the Department of Education. In some cases, the 
Department did not receive these scores, and, a?» a result, they are recorded as 
an 

The triple asterisk occurs only for the lower-achieving school of Pair G 
in language and spelling, 1^72-73. A check of Department of Education com^ 
puter records indicates that only one child took the language test and none 
took the spelling test. The Department is unable to account for this occur- 
rence because the computer program for sample selection specified that only 
schools with more than 16 students tested in each subject area would be 
eligible for participation. A rechecking of records reveals that the lower- 
achieving school in Pair G does meet the minimum standard for all other tests 
and years. Therefore, on the basis of the seven-year data, it was determined 
that the selection was appropriate. 



ERLC 



50 



2. Hypothesis Testing 



Additionally, in tables A-2 through a series of tables displaying a 

typical analysis of the study is presented. The vector displayed is entitled 
principal support , which measured the behavioral characteristics of prir.cipals 
toward teachers a^id the school community. 

In the tables in Appendix A are presented (1) a univariate analysis of 
variance for each of the components within the principal^support vector; and 
(2) an analysis of the vector itself in a multivariate analysis of variance. 
In each of the univariat;e and the multivariate analyses were used planned 
comparisons and conducted hypothesis testing at the level of a » .05 per 
family of hypotheses. 

In these analyses was presented standard tables, including the correlar 
tion coefficient (W^ ) as a ratio of the variance explained by each variable 
to the total variance. Also present was another statistic, the coefficient 
of partial correlation (Vp) as the ratio of the variance explained by each , 
hypothesis to the sum of the variance of the hyr'>th€sis plus error variance. 
The rationale for inclusion of this latter vari..Dle is that the variance 
accounted for by the background variables is removed ^nd then the rcimaining 
variance is focused on as that which can be explained by educational variables. 
Then the portion of variance which is unexplained by background can be explained 
by particular educational variables. 

3. Vector Composites 

In the analysis of the data, individual items were combined into a series 
of vector combinations, and those combinations were subsequently labeled. 
TaMe A-12 contains a list of the ten major composites and their P-values, 
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TABLE A-1 



Summary of Sixth-Grade AchievewnC Scorea for the Forty- two Schools 
in the School Kf fectiveneaa Study, 1969-70 through 1975-76 




SES: 
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I - low 
T, • medlure 
3 • high 



Locale: 



city 

auburb 

rural 



Minority: 1 • a^all p«rcantaga 

2 - oKKtarata p4rcantage 

3 » high parcaataga 



Sisa; I • amall €th grada 

2 « madlum ^th gmda 

3 • large 6th Rr/ide 



•*M - NO dat* avaiUblG 
S— Explanation in text. 
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lABLE A-2 



Analysis of Variance 
Priacipal Support: uelping Teachers with isew Ideas 



Sourca 


df 


SS 


MS 


F 




Wp2 


Achievement 
High V. Low 


1 


11.96 


11. 96 


10.09* 


.02 


.03 


Background Factors 

X K^y V m L a 1. 

Suburb V. City & Rural 

Kiddle SES v. High SES 

Low SES V. Middle & High SES 

Low Minority v. Middle Minority 

Hj-M Mjnority v. Low & Middle Minority 

Sd' Size 


2 


0.10 
9.83 

0. 11 
4.92 

1. 85 
2.93 

29.30 


0.10 
9.83 

0. 11 
4.9? 

1. 85 
2.93 

14.65 


0. 08 
8.29** 

.09 
-..15 

1. 56 
2.47 

No Test 


.02 


.03 


Intcr.ict- ^*on of Achievement w Vh Background Factors 
Achievenent x (City v. Rural) 
o /vdi 1 e V tjincn c x \oUDurD v, ( icy & Rural) 
Achievriient x (Middle SES . High SES) 
Achiev -ent x (Low SES v. Middle & High SES) 
Achinvenont ^Low Minority v. Middle Minority) 
Achievement x (High Minority v. Low & Middle 

Minority) 
Achievement x (School Size) 


\ 

1 
2 


3.69 
1.20 
14.89 
3.04 
0.92 

1.81 
26.76 


3,f 9 
1.20 
14. 89 
3.04 
0.92 

1.81 
13.38 


3.11 
1.01 
12. 56** 
2. 56 
0. 77 

1.52 

No Test 


.03 


.04 


xnceraccion or BuCKgrounu Factors ' 
With One ^mother 


2u 


47.29 


2.36 








Within Cells 


312 


371.28 


1.19 








Total 


349 


531.88 


1.52 


i 







* p .05 
** P .0083 



5-1 
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TABT,E A-3 

Principal Support: Backin/ Up Te;<chers on Student DisripMne 

(TI 15 B) 



Source 


df 


SS 


m 


F 


^2 


/\ „ 


Achievement 
High V. Low 


i 


11.69 


11.69 


lii,81* 


.02 


.04 


Background Factors 
City V. Rural 
Suburb V. City & Rural 
^!iclcUe SES v. High SES 
Lou SES V. Middle & High SES 
Low Minority v. Middle Minority 
Hiqh Minority v. L^w & Middle Minoricy 
School Size 


1 1 

i 1 
1 
1 
1 
1 

' 


0.17 

0. 07 

1. 76 
00 

0.02 
82.22 


0.17 
0.07 
1.76 
1.00 
0.02 
41.11 


i. D • O J 

0.19 
0.07 
1.93 
1.10 
0.02 
No Test 


• U J 




In^^. action of Achi /oment with Background Factors 
^ Achievement x (City v. Rural) 
U5 Achievement x (Suburb v. City & Rural) 
Acliievonent x (Middle SES v. High SES) 
Achievement x (Low SES v. Middle & High SES) 
Achievenent x (Low Minority v. Middle Minority) 
Achievenent x (High Minority v. Low & Middle 

Minority) 
Achievenent x (School Size) 


I 

1 
1 
1 

1 

2 


5. 08 

9 C\l. 
Z • U J 

1.41 
2.70 
0.02 

2.38 
20.44 


5.08 

Z . U J 

1.41 
2.70 
0.02 

2.38 
10. 22 


5.56 

9 9 9 

1.55 
2.96 
0.02 

.61 

No Test 






inueracuion or DacKgrouna ractors witn One 
Ai*other 


20 


61.95 


3.10 








Within Cells 


J12 


283.92 


• "1 








Total 


349 


492 . 09 


1.41 









p < . Ob 
p < .0083 
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TABLE A-/j 

Principal Support: Suj>poft1n^ Sperl.-^l Project*; 



(TI 15-C) 



Source 


df 










A 




SS 


MS 


F 




Wp' 

IT 


i^chievemcnt 














High V, Low 


1 


9. 58 


9. 58 


9.72* 


.02 


. 03 


Back c, round Tactors 














LI Ly V, Kurai 




n 0 9 
u , u z 




0.02 






Suburb V. City & Rural 


1 


0.07 


0.07 


0.07 






Piddle SES v. liiqh S^::S 


1 


3. 50 


3. 50 


3.55 






Lov/ srs V. Middle & Hiqh SES 


1 


3.12 


3.12 


3.17 






Low Minority v. Middle Minority 


1 


C. 22 


0.22 


0.23 






Hiqh Minority v. Low & Middle Minority 


1 


4.83 


4.83 








School r-ize 


2 


13.16 


6. 58 


No Test 






^nterc-icLion of Achievcncnt with Background Factors 














.'^chiove:nent x (City v. Rural) 


1 


0.58 


0. 53 


0.59 






*• i J i t« V ii it- 1 1 L. A \«DUtjui.ij v» 1 Ly « Kuraxi 


1 




0 on 


n n n 






Achlevcncnt x (Middle SCS v, high SES^ 


1 


0.29 


0.29 


0.29 






Aciiievercnt x (Low SES v. Middle & High SES) 


1 


1.58 


1. 58 


1.60 






/vcnie vortcn t x u ow Minority v, Miuule Minority) 


1 


n m 




u • U 1 






Achievement x {High Minority v. Low & Middle 




1.53 










Mi nori ty ) 


1 


1. 53 


1.55 






Achievenent x (Sciu, ' Size) 


2 


2.64 


1. 32 


No Test 






Interaction of Backaround Factors with Onp ! 














Another i 


20 


44. 36 


2, 22 








Within Cells | 


312 


308. 88 


.99 








Total 


349 

- i 


394. 37 




i 







2 



* p <,05 
* * p . 0 0 B 3 
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TABT,E A-5 

Principa] Supprrt: Relntlnns with Pnrents, roTriTnum' try 



(TI 15 



O \J U I. w t. 


df 












^ . . 


SS 


MS 


F 






Achievement 














High V. Low 


1 


18.87 


18.87 


22. 14* 


.05 


.07 


BackgrounrI Foe tors 






1 








City V. Rural 


1 




0.18 


0. 22 






Suburb V. City & Rural 


1 


3,90 


3.90 


4.57 






Fiddle SES v. ligh SES 


1 


0.07 


0.07 


0.08 






Lev; SES V. Middle & High SES 


1 


0.53 


0. 5^ 


0.62 






Low Minority v. Middle Minority 


1 


0.83 


0.83 


0.97 






High Minority v. Low & Middle Minority 


X 


n. Ofa 


0.08 


0.09 






School Size 


2 ! 


25.64 


12.82 


No Test 






Interaction of AchicvorriGnt with Background Factors 














Achievonont x (Citv v. Rural) 


1 


7.02 


7.02 


8.24** 


.02 


.03 


^ Acn i G V erren t. x ^bUDurD v. ty & Rural) 


1 , 


1.67 


1.67 


1. 96 






i^chievcnent x (Middle SES v. High SES) 


1 


3.75 


3.75 


4.40 






Aciiievornont x (Low SES v. Middle & High SES^ 


.1 ' 


0.51 


0.51 


0.60 






Achievenont x (Low Minority v. Middle Minority) 


1 1 


0 .59 


0.59 


0.69 






Achievoncnt x (High Minority v. Lew & Middle 


1 












Minority) 


1 i 


1 .05 


1.05 


1,23 






Achievement x (School Size) 


2 1 
1 


5.94 


2. 97 


No Test 






xii i. i_ jLuii or DdCfvy r oua*^ racuors wicn unt? 


I 












Another 


2 0 


39.00 


1.95 








Within Cells 


312 

I 


26 5. 2 


. 85 








Total ; 


34 9 

1 


374.83 

1 


[ 

1 . 07 j 









* n < . 0 5 
** p < . 00 8 3 
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TAbLE A-6 



f'rincipai Support: Rerort Keeping 



(TI 15 E) 



Source 


1 

df 




MS 


F 


W 




Achievement 
High V. Low 


1 


2. 13 


2.13 


1.93 






Background Factors 
City v« Rural 
Suburb V. City & Rural 
riddle SES \ . High SE*=^ 
Low SES V. Middle & High* SES 
Low Minority v. Middle Minority 
Hiqh Minority v. Low & Middle Minority 
School Size 


1 
1 
1 
1 
1 
1 
2 


6. 58 
17.70 
4.98 
3.41 
0. 53 
0. 06 
54.04 


6. 58 
17.70 
4.98 
3.41 
0.53 
0.06 
27.02 


5.94 
15 .997** 
4.50 
3.08 
0.48 
0.06 
No Test 


.03 


.05 


Interaction of Achievement with Ba, kground Factors 
;vchievenent x (City v. Rural) 
Achievement x (Suburb v. City & Rural) 
Achievement x (Middle SES v. High SES) 
Achievement x (Low SES v. Middle & High SES) 
Achievement x (Low Minority v. Middle Minority) 
Achievement (High Minority v. Low & Middle 

Minority) 
^chieve^.ent x (School Size) 


1 

1 

1 
1 
1 

1 

2 


1.61 

0 . w J 4 
8. 18 

1. 86 
1.73 

1.16 
9.80 


1. 60 
0.00 
8.18 
1.86 
1.73 

1 .16 
4.90 


1.45 

0. 00 
7. 39** 
1.681 

1. 56 

1.0b 

No Test 


. 02 


.02 


Interaction of Background Factors with One 
Another 


20 


45.91 


2.30 








v;ithln Cells 


312 


346. 32 


1.11 








Total 


349 


506.05 


1.45 









* D < .05 
** D < . 0083 




TABLL A-7 

i'rincipai Support: Support for Teaching Staff 



(TI 20 A} 



Source 


a I 














s s 


MS 


r 


W 


















fi 1 v< i 1 V • LjOw 


1 


11. 22 

1 


11.2 


13.43* 


.03 


.04 


D<ic (j r o wnu i ncuors 




1 










Lity V, rural 


1 


1.86 


1 . 86 


2.22 






wSuburb V. City & Rural 


1 


' 0.00 


0. 00 


0 no 






riddle FLS V. High SCS 


1 


' 0.73 


0.73 


0.87 






biS V, i-! Id ale & !Ii<;h SrS 


1 


0.05 


0. 05 


0.06 






lo'v Kino i ty v. IticMlo Minority 


1 


0. 01 


0.01 


0.01 






!iic:h Minority v. Lo*.; ft f*id(!le Minority 


1 


1. 99 


1.99 


2. 3S 








Z 


21.52 


10.76 


No Test 






In ^ ra c V, : on of Achiovor.ont \:ith HacJiq round Factors 














:.i'^V'\- ent x (City v. iVaral) 


1 


U . 95 


0.95 


1.14 






^ -'^nt x (Sa!;virb v. City & Rural; 




^ . D 3 


2.65 


3.17 I 




Ac^.icvrr^nt x (Miifldle SliS v. Hicja Si:S) 


1 


6.12 


6.12 


7.33** 


.02 


. 02 


Acaitjvcr ont x (Low SCS v. Middle & Hicjh SCS) 


1 


5. 08 


5.08 


6.08 






Acb. v^r ^-n t x (Low Minority v. MicMle Minority) 


1 


2.. ii 


2.33 


2.79 






Achiov. r^ nt x (Hiqh M.inority v. Low & Middlo 














M.i rvjri ty ) 


L 


3.54 


3.54 


4.24 






Acp.iov''^: ont x (School Size) 




1. on 


0.50 


No Test 






lutf'raction of Background Factors with One 














AnotliOr 


20 


59.28 










v;ithin Cells 


312 


262. 08 


. 84 








Total 


349 


380.41 


1 . 09 









* p < . 05 
** p < .G0B3 



65 



TARLE A-8 



Principal Support: Attenc^ance and Discipline of Stuc^pnts 



Source 










T ■' 






df 


SS 


MS 


F 






iiicvcrncnti. 














nign V, LOW 




8.13 


8.13 


10. 27* 


.02 


.03 


Dap^cJrou^a t tictors 














City V. Rural 


1 


7.63 


7 6 3 






• U J 


Suburb V. rity L Rural 


1 


2.25 


2.25 


2.84 






, i xucUG r)L.o V. illvja SLS 


1 


0. 06 


0.06 


0. 08 






LO.. Slo v. Middle & High 5KS 


1 


4. 51 


4.51 


5. 69 






Lo'v 'minority v. Itidd-e ''inority 


1 


0. 67 


0.67 


0. 85 






Mi^:h Minority v. Low & Twiddle Minority 


1 


0.23 


0.23 


0.29 






bCliOOl blZG 


2 


99. 90 


^.9. 95 


No Test 






Internet ion of Achicvonent \;ith Rackground Factors 














A-:-, i^vc^r* nt x (City v. Rural) 


1 


1. 37 


1. 37 


1.73 






^ Aciiiov'.^r t x (Sw.jorb v. Citv & Rural) 


1 


2. 64 


2.64 


3. 34 






Achieve • ont x C^iddle SCS v. High SES) 


1 


2.67 


2.67 


3. 38 






Achiov. cnt x (Low SLS v. Idle fi. High SES) 


1 


3.0/ 


3. 07 


3. 87 




J 

y 


Achiov* ^:ont x (Low Minoritv v. MicVllp Mi nnri f-\/^ 


1 


0. 02 


0. 02 


0. 02 




Acl)icvo:ont x (liigh Minority v. Low £, Middle 




1.42 








/ 


:*incrity) 


1 


1.42 


1.79 




/ 


Achiovercnt x (School Size) 


c 


17.72 


8 . 86 


No Test 






Intorartion of Background Factors with One 














/vTiO tiler 


20 


33.99 


1. 70 








Within Cells 


312 


246,48 


. 79 








Total 


J 19 


432.76 


1.24 




1 
1 





* P < .05 
** p < .0083 
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TABLE A-0 

Principal Support: InstriK Honal Leadership 



Source 



Achievomont 
llicjh V. Low 

Background Factors 
City V. Rural 
Suburb V. CiLv S, 



Rural 



r:iddlc SES V. h.gh SCS 
Lo\: SCS V Middle & High SES 
I-O'.v Minority v. M.iddle Minority 
liiv ''inority v. Low S> Middle Mir.ority 
Schcol- Size 

Interaction of Achiovonont \.'ith Backgr'-'-nd Factors 



Arli If vor'ont 
Ac!iiovorcnt 



Ac h i e ' 



X 
X 
X 

I oat X 
ront X 
r cnt X 



(City V. Rjral) 
(Suburb V. City 



& Rural] 



\cl.iovorrnt x (Middle SLS v. High SES) 



Minor L ty) 
Ac}i lovo 



(Low SES V. Middle & High SLS) 
(Low Minority v. Middl^^ Minority) 
.(High M.inority v. Low S Middle 



" X (School >iiie) 



Ini'^raction ot Background Factors with One 
/vT.otl'.or 



Witnin Cells 



Total 



df 



1 
1 
1 
1 
1 
2 



1 
1 
1 
1 
1 

1 

2 



20 



312 



349 



SS 



10. 33 



0.03 
5. 31 
0. 30 
3. 10 
0.90 
0. 34 
25. 18 



O.IU 

' .11 
40 
14 

0.59 
2.14 



99,^9 



390, 



547. 93 



MS 



10. 33 



0. 03 
5. 31 
0. 30 
3. 10 
C. 90 
0. 34 
12. 59 



0. 10 
2.91 
4.17 
0.40 
2.14 

0. -j9 
1.07 



5. 00 



1. 25 



Tl 20 D) 



8. 27* 



0. 02 
1.25 
0.24 
2.48 
0.72 
0.2/ 
No Test 



0.08 
2.33 
3. 34 
0. 32 
X. 71 

0.47 

No Test 



.02 



* p < .05 
** p < .0083 



C8 



TABLE A- 10 

Principal Support: Distribution of Materials 











(TI 


20 




Source 


df 


SS 


IAS 




w- 




Ach ir^verx.nt 
Kiwh V. Low 


1 


4. 79 


4.79 


5.53* 


.01 


.02 


Bac-; :r :i:n(l Tactors 
City V. Rural 
SvA.'iil) V. City & Rural 
r\.]C.lc rCG V. lliya SliS 

Frs Middle fi Iliqh SIS 
Ir Minc-rity v. .Middle Minority 
• : .a M;r^.^^rity Lo\; Middle Minority 
Sc" .ol 1 I ::e 


1 
1 
1 
1 
1 
1 
2 


0.65 
3. 35 
1.35 
0. 00 
2.64 
U.G5 
19. 88 


0.6^ 
3.35 
1.35 
0.00 
2.64 
0.65 
9.94 


0. 75 
3.86 
1.56 
0.00 
3. 05 
0.75 
No Test 






Int ' -r^^'u of Acl)if. vnr.'^nt \;itl) nacV.qrcund lactors 

/ . 'U';t X (City V. Rural) 
? ; ',:-j.'\.'nt X (Suijurb v. City & Rural} 
; J' :-r,t X (M.i(l']lo v. lii^h GLS) 
Ac. ^u'.., -nt X (Lo;; :>LS v. Middle & Hicjh £LS) 
Arl-.-v : .u\t X (Lo-,/ Minority v. ^'iddle Minority) 
• -nt X (Hlqh r^inority \. I^r.^/ & Middle 
:.ty) 

Ac^ii- ,.-ont X (S'jhool Si^o) 


1 
1 
1 
1 
1 

1 

2 


0. 34 
2.41 
5.73 
0.03 
0. 84 

1.51 
.62 


0. 34 
2.41 
5.73 
0.U3 
0.84 

1.51 
0. 31 


0. 39 
2. 78 
6.61 
0.03 
0.97 

1.74 

No Test 


- 




Int'>ract ion of Background Factors with One 


20 


46.73 


2. 34 








Within Cells 


312 


271.44 


.87 








Total 


349 


362.96 


1.04 









* * 



P < . 0 5 
p < . J 0 d 3 



7 o 
ERIC 
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TABLL A- 11 
Principal Support 



Source 



Achievement 
Jiigh V. Low 



2.99* 



Backgrounrl Factors 
City V, Ru* .1 
Suburb V. City S, Rural 
riddle SE3 v. High SCS 

SC3 V. Middle & H"qh SES 
Low Minority v. Twiddle flinority 
lii^h .minority v. Low & riddle ninority 
School Size 



3.09** 
2.25 
2.74** 
1. 38 
1.93 
AO Test 



Intorcction of Achievcnont v/ith nackground Factors 
Achiovcrcnt x (City v. Rural) 

(Suhiirb V. City & Rural; 



Achieve^ on t 
Achicvcncnt 
Aciuc vcr on t 
Achicvcnoii t 
hchiovnr cut 
r.inori ty ) 
Achacvor.ont 



X (Middle SES v. High SES) 

X (Low SES V. .Middle & High SES) 

X (low Minority v. Middle Minority) 

X (High riinority v. Low g Middle 

X (School Si:^G) 



1.80 

2.59*»' 

2.43 

1.31 

0.73 

2.20 
No Test 



* p <.05 
** H < .0083 
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iable A- 


-12 






Composite Name, 




by P-Value 

& 




Composite 


name 




P-value 


Principal 


support 




.0002 



Teacher effort 


.0003 


Classroom atmosphere 


.0001 


Amount of time spent on various subjects 


.0042 


iJse of teacher aides 


.U001 


Accessibility of .materials 


.0002 


Faculty influence 


,0001 


iJistrict administration 


.0004 


Groupx ig practices 


.0075 


leacher satisfaction 


.0545 
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Appendix B 
A Guide to Statistical Terms 



Throughout this report a number of statistical and technical tenns have 
been used to describe various procedures. In the preparation of this report, 
a quandary developed over whether to use these technical terms or to substi- 
tute simpler language. The final deqiiJ/Jh was to use the technical terms for 
accuracy and for the benefit educational researcher." who will read th.s 
report and draw conclusions regarding )its merit. However, at the same time 
it is recognized that a number of others will read this report with an eye 
less to the design strategies employe^nd more to the practical implications 
for schools and school districts. It iVfor this second group that a listing 
of terms and definitions has been developed: *. 

ANALYbIS OF VARIANCE: A mt .hod of identifying, breaking down, and testing 
for statistically significant differences between two or more groups. Some 
differences are due to the research method used, some to error, and s.n^e to 
school pr -tices. Analysis of variance techniques help researchers learn how 
much of the difference is attributable to each. 

COLEMAN REPORT: The popular name for the Equality of Educational Opportunity 
report. In 1964 the U.S. Congress mandated a study of the availability of 
educational facilities and opportunities for children of different races. In 
addition to analyzing school resources, James Coleman, the author of the 
report, also discussed scr-oling's effect on achievement scores. In doing so, 
he stated that differences in achievement were relnted mor% to differences in 
children s home background than to differences in educational opportunities. 

CORRELATION : A measure of the degree of similarity of one Prcup to another. 
Most correlations range from -1.00 through 0 to +1.00. A correlation of +1.00 
indicates a perfect positive relation; -1.00, ? perfect negative relation; and 
0, no relation. 

CURVE OF BEST FIT: The shape of the line which most closely connects the 
variables of a group when tney are displayed in a scatterplot. before 
detennining the appropriate statistical analysis, one often arrays the data 
in charted form o determine tht appropriate statistical technique. 

INDEPENDENT AND DEPEND::NT VARIAm.KS: Names used to categorize variables. "An 
independent variable Is the presumed cause of the depe..dent variable; the pre- 
sumed etfect. The Independent variable Is the antecedent, the dependent is 
the consequent. When we say: If A, then 6, we have the conditioned conjunc- 
tion of an independent variable (A) and a dependent variable (B) . ^ In the 
present study student achievement is the dependent variable. Children's home 
background, JQ, - nd family income are independent variables. A search is 
being conducted for additional independent variables (that is, school factors) 
which might also affect achievement. 



Fred N, Kcrlinger, Foundations of Behavioral Re search 
Kinehart, and Winston, 1973. 



rch . New York: Holt , 




NATURAL VAkIATIQN : Differences which occur as a matter of course; the oppo- 
site of planned or experimental variation. In education, researchers in 
, natural variation studies visit a group of schools and allow them to operate 
normally. Experimental design, by contrast, would involve setting up two 
scnools or groups of schools and telling administrators and teachers what Co 
do. Most probably, they would be told to operate in exactly the same manner 
except in one area where their methods would differ sys'-ematically • Then 
researchers could determine if a difference in that area affected achievement. 
Although experimental design would create a more simple design, a question 
arises regarding the ethics of submitting young children to experimental 
situations in an area as important as education. 

REGRESSION ANALYSIS : "A method of analyzing the contributions of one or more 
independent variables to one dependent variable. "2 

RESIDUAL : A score calculated by subtracting the obtained score from the 
predicted score. 

REVIEW OF THE LITERATURE : A summarization of and commentary on the published 
material in a given field of learning. 

SCATTLRPLOT : A chart containing two axes on which points are plotted. This 
provides a pictorial view of the data. 

STATISTICAL SIGNIFICANCE : A finding which denotes that the difference be- 
tween the means of two groups- is of such ^ size that the difference would 
occur by chance only five tines in one hundred trials- Another way of statino 
the issue: If two groups of persons answered questions randomly, would :*the 
difference be as large as the one existing? When it is said that the dif- 
ference is s^ -'tistically significant, what is meant Is that if the experiment 
were repeated 100 times and no difference existed bptween the reans, in only 
five cases would the means show differences as large as those found. 

STRATIFICATION OF VAPIABLE S: Division of variables into subcategories (for 
example, breaking down schools by size — small, medium, or large; by percent- 
age minority attendance — small, medium, large; or by type of location — rural, 
^suburban, urban) . 



"Ibid. 




LR76 16 (»«cond printing) 300 75228 6 77 



I 

• both ralatlyal^ and abaplutely than to men) , but both women and men rated 
themaei^eB high on that characteriatlc. 

Three peraonal characteristics were indicated to be important to possess^ 
but the students rated themselves as relatively poor in their development. 
These weret 

Self-confidence 
Sal^acceptance ♦ 
Self-discipline. 

Thera were also several personal characteristics on which freshmen rated 
themselves high that were indicated to be relatively unimportant to possess. 
Students, particularly men, rated themselves high on the:'r Ability to cope with 
competition, yet neither women nor men indicated that ability was very important 
to possess. Women rated themselves high on their Ability to cope with sexual 
desire, but neither women nor man indicated that it was very important to 
possess. 
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■ CONCLUSIONS 



Freshmen rated rhemselves highest on their Openness to new ideas and 
experiences, their Ability to cope with responsibility, t'aeir Integrity, and 
the following social abilities: 

f 

Understanding others'" valtles and accepting others'' differences 
Establishing and being comfortable with various degrees of 

Intimacy and trust in relationships 
Making and honoring conmltments to a long-term relationship 
Establishing and maintaining relationships that encourage the 

development and growth of each person 
Relating well to others. 

They gave their lowes.t self -ratings to their knowledge in all academic areas 
except the Natural Sciences and to their ability to cope with various adver- 
sities: Frustration, Failure, and Loneliness. 

The characteristics freshmen considered of most importance for them to 
possess were Self-confidence, the Ability to cope with responsibility, the 
Ability to relate well to others, and Openness'"^ to new ideas and experiences. 
Of least importance to possess was knowledge in the five academic areas: 

Natural Sciences 
Social Sciences 
Humanities 

Government, law, and politics ^ ^ 

Business, industry, and economics, . 

** 

Students expected their college experience to contribute most to 
enhancing their intellectual* abilities: 

Apply knowledge to new situations 

Open to new ideas and experiences 

Critically analyze information 

Integrate knowledge into a meaningful concept; 

^ their knowledge of the Natural Sciences; and three personal and social abilities: 
Ability to cope with responsibility 

EMC fi 



Ability to relate well to others . ' 
Ability to make detialona. 

College was expected' to contribute the least to* their .abilities to' cope with 
' Anger, Sexual desire, Fear, and Loneliness. • 

. Students generally expected their colleie experience to contribute -most to 
those aspects of their development that were of .greatest importance, for thea 
to possess. There were, however', three exceptions: ' ' 

Self-confidence . • 

Self- discipline * . 

Self-acceptance. . ^ " • ^ . 

These three attributes were of great importance to 'the stUdeutp," but; the 
freshmen gave themselves relatively low self-ratings arid expected the college 
experience to contribute to a smaller extent than to, the. other characteristics. 

These students (Will bq surveyed later during, their college experience in , 
order to study the development of their self-awareneas and priorities and the 
'facets of their dev4lopment to which the college experience doek and does -.not " 
contribute. 
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